Smart sensing techniques

ABSTRACT

Methods, systems, and devices for smart sensing using a security and automation system are described. One method may include monitoring a parameter of a resource associated with a structure, predicting a future change in condition associated with the parameter based on the monitoring, and performing a function using the security and automation system based on the predicting. In some examples, the resource may include a service or a product.

BACKGROUND

The present disclosure, for example, relates to security and automationsystems, and more particularly to smart sensing techniques in securityand automation systems.

Security and automation systems are widely deployed in a smartenvironment (e.g., a residential, a commercial, or an industrialsetting) to provide various types of communication and functionalfeatures such as monitoring, communication, notification, and/or others.These systems may be capable of supporting communication with a personthrough a communication connection or a system management action.

A smart home environment utilizing a security and automation system mayprovide automated control related to a subsystem of the smart home suchas a heating, ventilation and air condition (HVAC) system, a lightingsystem, a home theater and entertainment system, or a security system.Although some techniques related to sensing may improve the reliabilityof security and automation systems by informing personnel of sensedconditions, these techniques are inefficient and often requireunnecessary intervention by the personnel.

SUMMARY

The described techniques relate to improved methods, systems, orapparatuses that support smart sensing using a security and automationsystem. A control panel of a security and automation system may monitorand scan a number of sensing devices (e.g., one or more sensors) in asmart environment. The smart environment may be for example aresidential structure, a commercial building (e.g., an office, grocerystore, or retail store), or an industrial facility (e.g., manufacturingfactory), among others. The control panel may be in communication withat least one sensing device to monitor a parameter of a resourceassociated with the smart environment. A resource may be a service or aproduct. The service may be a structure management service (e.g., agardening and lawn care service) or a personal service (e.g., ababysitting service) related to an individual associated with the smartenvironment. The product may be an a household appliance (e.g., adishwasher), a consumable item, or a household item (e.g., cosmetics,laundry detergent, lightbulbs, health related items).

The control panel may predict a future change in a condition associatedwith the parameter of the resource based on the monitoring. To predictthe future change, the control panel may track real-time usage data andperform a statistical analysis, using the real-time usage data andhistorical usage data, to compute a prediction of the future change inthe condition. In some examples, the control panel may apply machinelearning techniques (e.g., support vector machines, decision trees,Naïve Bayes classification, ordinary least squares regression, logisticregression) to predict the future change in the condition. Once thecontrol panel has computed a prediction, the control panel mayautonomously proceed to perform a function to handle the resource (e.g.,replace, replenish, order, schedule), prior to the future changeoccurring.

Conventional techniques related to sensing may improve the dependabilityof the security and automation system by informing an individual ofsensed conditions. However these techniques are inconvenient and demandexplicit intervention by the individual. In view of the foregoing, it isdesirable to provide a smart sensing system which facilitatesmonitoring, predicting, and automatic autonomous functions performed bythe security and automation system to handle resources of the smart homeas necessary, or scheduling services related to the smart home.

Benefits of the present systems and methods include smart sensing, byenabling the security and automation system to intelligently monitor,predict, and automatically and/or autonomously handle resources of thesmart home. Thereby improving the operating characteristics of thesecurity and automation system (e.g., managing CPU and memory usagelevels, reducing latency, decreasing power consumption).

A method for smart sensing using a security and automation system isdescribed. The method may include monitoring a parameter of a resourceassociated with a structure, predicting a future change in conditionassociated with the parameter based at least in part on the monitoring,and performing a function using the security and automation system basedat least in part on the predicting.

An apparatus for smart sensing using a security and automation system isdescribed. The apparatus may include means for monitoring a parameter ofa resource associated with a structure, means for predicting a futurechange in condition associated with the parameter based at least in parton the monitoring, and means for performing a function using thesecurity and automation system based at least in part on the predicting.

Another apparatus for smart sensing using a security and automationsystem is described. The apparatus may include a processor, memory inelectronic communication with the processor, and instructions stored inthe memory. The instructions may be operable to cause the processor tomonitor a parameter of a resource associated with a structure, predict afuture change in condition associated with the parameter based at leastin part on the monitoring, and perform a function using the security andautomation system based at least in part on the predicting.

A non-transitory computer-readable medium for smart sensing using asecurity and automation system is described. The non-transitorycomputer-readable medium may include instructions operable to cause aprocessor to monitor a parameter of a resource associated with astructure, predict a future change in condition associated with theparameter based at least in part on the monitoring, and perform afunction using the security and automation system based at least in parton the predicting.

Some examples of the method, apparatus, and non-transitorycomputer-readable medium described above for monitoring the parameter ofthe resource may further include processes, features, means, orinstructions for receiving real-time usage data of the resource from asensor, and tracking real-time usage data based at least in part on theusage data. In some examples, of the method, apparatus, andnon-transitory computer-readable medium described above for performingthe function may be based at least in part on tracking the real-timeusage data.

In some examples of the method, apparatus, and non-transitorycomputer-readable medium described above, the resource may include aservice or a product. Some examples of the method, apparatus, andnon-transitory computer-readable medium described above may furtherinclude processes, features, means, or instructions for identifying theservice or the product, or both, retrieving, from a database, historicalusage data associated with the service or the product, or both based atleast in part on the identifying, and comparing the retrieved historicalusage data with the real-time usage data to compute a usage model. Insome examples, of the method, apparatus, and non-transitorycomputer-readable medium described above for predicting the futurechange in condition associated with the parameter may be based at leastin part on the usage model.

In some examples of the method, apparatus, and non-transitorycomputer-readable medium described above, the function may be performedautomatically based at least in part on a pre-configured setting of thesecurity and automation system. Some examples of the method, apparatus,and non-transitory computer-readable medium described above may furtherinclude processes, features, means, or instructions for identifyingschedule data of an individual associated with the structure, andautomatically scheduling a service personnel to visit the structure andperform an action associated with the service based at least in part onthe schedule data of the individual. In some examples, of the method,apparatus, and non-transitory computer-readable medium described abovefor performing the function may include automatically scheduling theservice personnel.

Some examples of the method, apparatus, and non-transitorycomputer-readable medium described above for automatically schedulingthe service personnel may further include processes, features, means, orinstructions for identifying a service provider associated with theservice based at least in part on a pre-configured setting, andtransmitting, to a remote device of the service provider, a messageindicating a service request. In some examples, the message may includeat least one of a payment information, a geolocation information of thestructure, a contact information of the individual, or any combinationthereof. Some examples of the method, apparatus, and non-transitorycomputer-readable medium described above may further include processes,features, means, or instructions for receiving, from the remote device,an acknowledgment message in response to the service request.

Some examples of the method, apparatus, and non-transitorycomputer-readable medium described above may further include processes,features, means, or instructions for detecting the service personnelbased at least in part on sensor data received from a sensor,identifying a time associated with the detecting, comparing theidentified time to a scheduled service time, validating that theidentified time is within a threshold limit of the scheduled servicetime, and providing, to a device of the service personnel, accessinformation to the structure based at least on the validating, whereinthe access information comprises at least one of a random code, apersonal identification number (PIN), or instructions for providing theservice to a designated zone of the structure, or any combinationthereof.

Some examples of the method, apparatus, and non-transitorycomputer-readable medium described above for performing the function mayfurther include processes, features, means, or instructions forproviding to the device of the service personnel the access informationto the structure.

Some examples of the method, apparatus, and non-transitorycomputer-readable medium described above may further include processes,features, means, or instructions for operating a garage door openerbased at least in part on the validating. Some examples of the method,apparatus, and non-transitory computer-readable medium described abovefor performing the function may include operating the garage dooropener.

Some examples of the method, apparatus, and non-transitorycomputer-readable medium described above may further include processes,features, means, or instructions for determining that the product may bea consumable item, identifying a consumption rate of the consumable itembased at least in part on a consumption model of the consumable item,and automatically requesting a purchase order with a third-partyenterprise to restock and deliver the consumable item to the structure.In some examples of the method, apparatus, and non-transitorycomputer-readable medium described above, the consumable item mayinclude at least one of food or beverages, or both.

Some examples of the method, apparatus, and non-transitorycomputer-readable medium described above may further include processes,features, means, or instructions for determining that the product may bean apparatus or a household item, identifying a usage rate of theapparatus or the household item based at least in part on a usage modelof the apparatus or the household item, and automatically requesting apurchase order or a maintenance order with a third-party enterprise torestock and deliver the household item to the structure or provide amaintenance service of the apparatus.

Some examples of the method, apparatus, and non-transitorycomputer-readable medium described above may further include processes,features, means, or instructions for establishing a connection with theapparatus, and retrieving specification information associated with theapparatus based at least in part on performing a scan using theestablished connection. In some examples, the specification informationmay include warranty coverage information, appliance repair and supportinformation, vendor information, an energy consumption and cost reportof operating the apparatus, or any combination thereof.

Some examples of the method, apparatus, and non-transitorycomputer-readable medium described above for performing the function mayfurther include processes, features, means, or instructions fordetermining a set of recommended actions to perform based at least inpart on the future change in condition, generating a message indicatingthe future change in condition and an option to select at least onerecommended action from the set, and transmitting the message to adevice of an individual associated with the security and automationsystem.

Some examples of the method, apparatus, and non-transitorycomputer-readable medium described above may further include processes,features, means, or instructions for receiving, from the device, amessage indicating a selection of a recommended action from the set.Some examples of the method, apparatus, and non-transitorycomputer-readable medium described above for performing the function maybe based at least in part on the received message.

In some examples of the method, apparatus, and non-transitorycomputer-readable medium described above, the service may be a structuremanagement service or a personal service related to an individualassociated with the structure. In some examples of the method,apparatus, and non-transitory computer-readable medium described above,the structure management service comprises at least one of a gardeningand lawn care service, an internet-provider service, a housekeepingservice, a laundry service, a plumbing service, a maintenance service, atermite and pest control service, a water softener service, or anycombination thereof. In some examples of the method, apparatus, andnon-transitory computer-readable medium described above, the personalservice comprises at least one of a babysitting service, a nursing careservice, a pet sitting service, a medical provider visit service, or anycombination thereof.

The foregoing has outlined rather broadly the features and technicaladvantages of examples according to this disclosure so that thefollowing detailed description may be better understood. Additionalfeatures and advantages will be described below. The conception andspecific examples disclosed may be readily utilized as a basis formodifying or designing other structures for carrying out the samepurposes of the present disclosure. Such equivalent constructions do notdepart from the scope of the appended claims. Characteristics of theconcepts disclosed herein—including their organization and method ofoperation—together with associated advantages will be better understoodfrom the following description when considered in connection with theaccompanying figures. Each of the figures is provided for the purpose ofillustration and description only, and not as a definition of the limitsof the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

A further understanding of the nature and advantages of the presentdisclosure may be realized by reference to the following drawings. Inthe appended figures, similar components or features may have the samereference label. Further, various components of the same type may bedistinguished by following a first reference label with a dash and asecond label that may distinguish among the similar components. However,features discussed for various components—including those having a dashand a second reference label—apply to other similar components. If onlythe first reference label is used in the specification, the descriptionis applicable to any one of the similar components having the same firstreference label irrespective of the second reference label.

FIG. 1 illustrates an example of a system for smart sensing using asecurity and automation system that supports smart sensing techniques inaccordance with aspects of the present disclosure.

FIGS. 2A and 2B illustrate example diagrams relating to an examplesecurity and automation environment that supports smart sensingtechniques in accordance with aspects of the present disclosure.

FIGS. 3A through 3F illustrate an example of a wireless device thatsupports smart sensing techniques in accordance with aspects of thepresent disclosure.

FIG. 4 illustrates an example diagram relating to an example securityand automation environment that supports smart sensing techniques inaccordance with aspects of the present disclosure.

FIG. 5 illustrates an example diagram relating to an example securityand automation environment that supports smart sensing techniques inaccordance with aspects of the present disclosure.

FIGS. 6A through 6C illustrates an example of a wireless device thatsupports smart sensing techniques in accordance with aspects of thepresent disclosure.

FIG. 7 illustrates an example diagram relating to an example securityand automation environment that supports smart sensing techniques inaccordance with aspects of the present disclosure.

FIG. 8 illustrates an example diagram relating to an example securityand automation environment that supports smart sensing techniques inaccordance with aspects of the present disclosure.

FIGS. 9A through 9C illustrates an example of a wireless device thatsupports smart sensing techniques in accordance with aspects of thepresent disclosure.

FIG. 10 illustrates an example diagram relating to an example securityand automation environment that supports smart sensing techniques inaccordance with aspects of the present disclosure.

FIG. 11 illustrates an example diagram relating to an example securityand automation environment that supports smart sensing techniques inaccordance with aspects of the present disclosure.

FIG. 12 illustrates an example diagram relating to an example securityand automation environment that supports smart sensing techniques inaccordance with aspects of the present disclosure.

FIGS. 13 through 15 show block diagrams of a device that supports smartsensing techniques in accordance with aspects of the present disclosure.

FIG. 16 illustrates a block diagram of a system including a controlpanel that supports smart sensing techniques in accordance with aspectsof the present disclosure.

FIGS. 17 through 21 illustrate methods for smart sensing techniques inaccordance with aspects of the present disclosure.

DETAILED DESCRIPTION

The described techniques relate to improved methods, systems, orapparatuses that support smart sensing using a security and automationsystem. The smart home environment may also have a control panel that anindividual may use to apply settings, preferences, and reminders, whichthe system may use in combination with additional data received from asensing device (e.g., a sensor), to provide programmed control to asubsystem of the security and automation system (e.g. a heating,ventilation and air condition (HVAC) system, a lighting system, a hometheater and entertainment system, or a security system). In some cases,a sensing device may be a multi-sensing device capable of sensingmultiple conditions (e.g., motion, temperature, light, audio).

In some cases, the security and automation system may learn a behaviorand patterns of the individual using the applied settings, preferences,and reminders, for executing operations related to the security andautomation system. For example, the security and automation system maylearn a schedule (e.g., school schedule, work agenda) of an individual(e.g., a parent, a child) using profile information saved with thesystem and data received from a sensor, to control a subsystem such as aHVAC system.

The control panel may be in communication with at least one sensingdevice to monitor a parameter of a resource associated with a smartenvironment. A resource may be a service or a product. The control panelmay predict a future change in a condition associated with the parameterof the resource based on the monitoring. To predict the future change,the control panel may track real-time usage data and perform astatistical analysis, using the real-time usage data and historicalusage data, to compute a prediction of the future change in thecondition. In some examples, the control panel may apply machinelearning techniques to predict the future change in the condition. Oncethe control panel has computed a prediction, the control panel mayautonomously proceed to perform a function to handle the resource (e.g.,replace, replenish, order, schedule), prior to the future changeoccurring.

In some cases, the at least one sensing device may be a standalonesensor or may be embedded, installed, positioned, or integrated with acomponent associated with the security and automation system. The atleast one sensing device may record, track, and provide information tothe control panel relating to a status of the component. In some cases,the status may include an indication of whether the component or aresource of the component requires a modification, an update, areplacement, or a replenishment, or any combination thereof.

The control panel may receive and process the information to identify afunction to perform. In some examples, processing the information mayinclude identifying information associated with the component, acondition at or related to the smart environment, or the resourceassociated with the component. For example, the control panel mayidentify that the information was received from a particular sensor(e.g., an HVAC sensor, an energy sensor, a lawn care sensor).Additionally, the control panel may determine whether one or moresub-components of the component or the component itself requiresmodification, an update, a replacement, or a replenishment based on thesensor data. If the control panel determines that a modification, anupdate, a replacement, or a replenishment is required, the control panelmay identify additional information, associated with the one or moresub-components of the component or the component, by retrieving theadditional information from local memory of the control panel, or adatabase, or a third-party source via the Internet.

The local memory or the database may include information such asspecifications (e.g., component details, sub-component details),ordering information, vendor information, location of the one or moresub-components or the component within the smart home, an address of apremises associated with the component, etc. The control panel may parseand retrieve the information from the database based on identifying theparticular sensor and the sensor data. For example, each sensing deviceof a component may have a unique identifier. The unique identifier maybe assigned to a sub-component or the component itself in the localmemory or the database. As such, the control panel may use the uniqueidentifier to identify the information. The control panel may generateinformation associated with the processed information and provide thegenerated information to an individual associated with the smartenvironment or a third-party enterprise, or both.

The generated information may include a description of the component orthe resource associated with the component. The control panel maycommunicate (e.g., automatically) and perform one or more functions withthe third-party enterprise. For example, the control panel may provideordering information to the third-party enterprise, or a schedule anappointment with the third-party enterprise to respond to the generatedinformation (e.g., may automatically schedule an appointment with anexterminator when a sensor detects termites, ants, or other pests). Thecontrol panel may automatically place an order with a service such thatservice is provided to a location of the component or the resourceassociated with the component. In some cases, the control panel mayschedule the appointment based on schedule information of the individual(e.g., a personal schedule, a maintenance schedule related to acomponent or related perishable resource of the smart home) stored inlocal memory of the security and automation system.

Alternatively, the control panel may wait to receive feedback (e.g.,authorization, acknowledgement) from the individual prior tocommunicating with the third-party enterprise. In some cases, thecontrol panel may track a pending status of the modification, theupdate, the replacement, or the replenishment of the sub-component orthe component, and provide notification, when the status is determinedto be completed. In some cases, the control panel may receive a servicecompleted signal from the third-party enterprise, the service completedsignal corresponding to a condition indicating that the service has beenprovided.

In some examples, the at least one sensing device may be an HVAC filtersensor. The HVAC filter sensor may record, track, and provideinformation to the control panel relating to a status of the HVAC filtercomponent. For example, a status may indicate whether the HVAC filtermay need to be replaced. In some cases, the HVAC filter sensor maydetermine that the HVAC filter may need to be replaced based on sensordata satisfying a threshold value. For example, the HVAC filter sensormay determine when the HVAC filter becomes congested with dust particlesor residue. Alternatively, the HVAC filter sensor may determine that theHVAC filter may need to be replaced based on a schedule. For example,the HVAC filter sensor may determine that the HVAC filter needs to bereplaced every number of days, weeks, or months.

The control panel may receive the information from the HVAC filtersensor. In this example, the control panel may determine the HVAC filtermay need to be replaced based on the received information. In someexamples, as provided above, the information may include a uniqueidentifier associated with the HVAC filter sensor that may correlate theHVAC filter sensor with a particular HVAC filter in the smartenvironment. The control panel may parse and retrieve additionalinformation (e.g., HVAC filter specification) associated with the HVACfilter from the local memory or the database; or in some cases from theInternet. Upon determining that the HVAC filter requires a replacement,the control panel may generate and transmit a message to an appropriateindividual (e.g., home owner) or a third-party enterprise. In someexamples, the message may include a description indicating that the HVACfilter may need to be replaced. In some cases, the message may alsoinclude ordering information, vendor information, address information,etc.

The control panel may also autonomously communicate and perform one ormore functions with the third-party enterprise. In this case, thethird-party enterprise may be a vendor or a primary manufacturer of theHVAC filter. As such, the control panel may provide ordering informationto the third-party enterprise. That is, the control panel mayautomatically order a new HVAC filter to be delivered to the environment(i.e., to the smart home) using the ordering information. Alternatively,the control panel may delay communication, until receiving feedback fromthe individual (i.e., homeowner), with the third-party enterprise. Insome cases, the control panel may track a pending status of thereplacement of the HVAC filter, and provide notification, when thestatus is determined to be completed.

In some cases, the at least one sensing device may be a water softenersensor. The water softener sensor may monitor a calcium and magnesiumlevel and/or water flow level of a plumbing component (e.g., faucet,valve, spout). The water softener sensor may record, track, and provideinformation to the control panel relating to the calcium and magnesiumlevel and/or the water flow level of the plumbing component. The watersoftener sensor may determine when the plumbing component has increasedcalcium and magnesium levels and/or reduced water flow, or detect a leakor other problem. Alternatively, the water softener sensor may determinethat the plumbing component may need to be replaced or replenished. Forexample, the water softener sensor may determine that the plumbingcomponent needs to be serviced (e.g., replenished by applying watersoftening chemicals) based on the increased calcium and magnesium levelsand/or reduced water flow. Alternatively, in some cases, the watersoftener sensor may determine that the plumbing component may need to bereplaced.

The control panel may receive the information from the water softenersensor. In this example, the control panel may determine the plumbingcomponent may need to be replaced based on the received information. Insome examples, as provided above, the information may include a uniqueidentifier associated with the water softener sensor that may correlatethe water softener sensor with a particular plumbing component in thesmart environment. The control panel may parse and retrieve additionalinformation (e.g., plumbing component specification) associated with theplumbing component from the database; or in some cases from theInternet. Upon determining that the plumbing component requires areplacement, the control panel may generate and transmit a message to anappropriate individual (e.g., homeowner) or a third-party enterprise. Insome examples, the message may include a description indicating that theplumbing component may need to be replaced. In some cases, the messagemay also include ordering information, vendor information, etc. Thecontrol panel may also communicate and perform one or more functionswith the third-party enterprise. In this case, the third-partyenterprise may be a vendor or a plumbing service. As such, the controlpanel may provide ordering information to the vendor or the plumbingservice. That is, the control panel may autonomously order a newplumbing component to be delivered using the ordering information.

Alternatively, the control panel may delay communication, untilreceiving feedback from the individual, with the third-party enterprise.In some cases, the control panel may track a pending status of thereplacement of the plumbing component, and provide notification, whenthe status is determined to be completed. In some examples, the controlpanel may add the plumbing component or a resource (e.g., watersoftening chemicals) associated with the plumbing component on ashopping list of the individual. As such, the individual may be remindedto purchase water softening chemicals at a later time; for example whenvisiting a business (e.g., a home goods store). The database may alsoinclude one or more service providers capable of supplying replacementparts corresponding to the HVAC filter, or the plumbing component, orthe appliance.

In some examples, the at least one sensing device may be a lawn caresensor. The lawn care sensor may record, track, and provide informationto the control panel relating to a status of a lawn. For example, astatus may indicate whether the lawn may need to be replenished (e.g.,watered). In some cases, the lawn care sensor may determine that thelawn may need to be watered based on sensor data. In some examples, thelawn care sensor may be a humidity sensor integrated with the lawn todetermine a humidity or moisture level of the soil. Additionally, thelawn care sensor may include or be augmented by an outdoor camera thatmay capture images of the lawn and determine based on the capturedimages (among other data) whether the lawn may need to be watered,fertilized, aerated, etc.

In some cases, the control panel may determine that the lawn may need tobe updated (i.e., mowed, weeds pulled) based on the captured image. Inthis case, the control panel may identify a learned preference or apre-stored setting of the individual. For example, the learnedpreference or the pre-stored setting may indicate to contact a lawn carebusiness (i.e., third-party enterprise). As such, the control panel mayparse and retrieve contact information associated with the lawn carebusiness via the database. The control panel may generate a message andtransmit it to the lawn care business. In some examples, the message mayinclude a request to schedule a personnel to visit the environment(e.g., home) to provide a lawn care service during a specified data andtime. The schedule may be based on a schedule of the individualassociated with the environment. The message may also include addressinformation associated with the environment (e.g., home). In some cases,the control panel may refrain from transmitting the message untilreceiving authorization from the individual associated with the smartenvironment via the control panel or from a remote device (e.g.,smartphone). The control panel may receive a reply message from the lawncare business confirming the request. In some cases, the control panelmay transmit a notification to the remote device of the individualassociated with the smart environment notifying him or her of thescheduled lawn care service. In some cases, the control panel may tracka pending status of the scheduled lawn care service, and providenotification to the individual when the status is determined to becompleted.

In some examples, the at least one sensing device may be a pest controlsensor. The pest control sensor may be integrated with or embeddedwithin one or more surfaces (e.g., walls) or components (e.g., anappliance, a light fixture) of the smart environment. For example, thepest control sensor may be installed within or on walls of a smart home.The pest control sensor may record, track, and provide information tothe control panel. For example, the information may indicate presence ofa pest. The control panel may use the information to notify anindividual or a third-party enterprise accordingly to respond.

In some examples, the at least one sensing device may be an appliancerepair sensor. The appliance repair sensor may be integrated with orembedded within one or more components of an appliance. An appliance mayinclude any household appliance such as a dishwasher, a fridge, an oven,a microwave, a refrigerator, etc. The appliance repair sensor maydetermine when one or more sub-components of the appliance or theappliance itself may need to be replaced based on sensor data (e.g.,usage data). The appliance repair sensor may provide information to thecontrol panel. Similarly, the control panel may use the information tonotify and coordinate replacement of the one or more sub-components ofthe appliance or the appliance itself.

Similarly, in some examples, the at least one sensing device may be ahousekeeping sensor. For example, the house keeping sensor may monitoran area such as a room. A control panel may determine when to schedule ahousekeeper to visit the smart environment based on sensor data receivedfrom the housekeeping sensor. The housekeeping sensor may include acamera. The camera may capture an image of the area and determine ahousekeeper requirement level. In some cases, the housekeeperrequirement level may be determined based on comparing a default imageof the area (i.e., assigned as a clean version of the area) to thecaptured image. If the control panel determines that the housekeeperrequirement level satisfies a threshold level, the control panel mayperform a function. For example, the control panel may contact andschedule a service with a housekeeping business (i.e., third-partyenterprise). In some cases, the housekeeping business may bepre-assigned by the individual. The control panel may receive a replymessage from the housekeeping business confirming the request.

Additionally or alternatively, the at least one sensing device may be alaundry sensor. The laundry sensor may be integrated with or in embeddedwithin a hamper. The laundry sensor may determine when to notify anindividual that he or she may need to do laundry based on an amount ofclothing sensed in the hamper. Notifying the individual may includetransmitting a message to the individual's device indicating that theamount of clothing within the hamper has reached a threshold level.

In some examples, the at least one sensing device may be a consumablessensor. The consumables sensor may be a multi-sensing component that maybe embedded or integrated with a physical compartment that storesconsumable items (e.g., foods). For example, a physical compartment mayinclude a refrigerator. Alternatively, the physical compartment may bean unrefrigerated compartment (e.g., pantry). The consumable sensor mayrecord, track and provide information associated with an inventory ofconsumable items stored in the physical compartment. In some cases, theconsumable sensor may identify one or more consumable items that mayneed to be replenished. The control panel may receive the informationassociated with the inventory of consumable items stored in the physicalcompartment. In this case, the control panel may identify one or moreconsumable items that may need to be replenished. The control panel maygenerate a message indicating the one or more consumables items to anindividual of the environment. In some cases, the control panel maynotify a third-party enterprise. In this case, the third-partyenterprise may be a vendor such as a grocery store. The control panelmay autonomously communicate with the vendor to schedule an order anddeliver of the required consumables items. The control panel may provideand support a secure delivery to the smart environment. In some cases,the control panel may indicate in a message, transmitted to the vendor,a location associated with the smart environment in which to deliver therequired consumables items. In this case, the control panel may use oneor more sensing devices to determine and identify a presence of adelivery person associated with the vendor at the smart environment.Based on the determination and identification, the control panel mayunlock an entrance to the smart environment.

The following description provides examples and is not limiting of thescope, applicability, and/or examples set forth in the claims. Changesmay be made in the function and/or arrangement of elements discussedwithout departing from the scope of the disclosure. Various examples mayomit, substitute, and/or add various procedures and/or components asappropriate. For instance, the methods described may be performed in anorder different from that described, and/or various steps may be added,omitted, and/or combined. Also, features described with respect to someexamples may be combined in other examples.

FIG. 1 is an example of a system 100 for smart sensing using a securityand automation system that supports smart sensing techniques inaccordance with aspects of the present disclosure. In some cases, thesystem 100 may include one or more sensor units 110, local computingdevice 115, 120, network 125, server 155, control panel 135, and remotecomputing device 140. One or more sensor units 110 may communicate viawired or wireless communication links 145 with one or more of the localcomputing device 115, 120 or network 125. The network 125 maycommunicate via wired or wireless communication links 145 with thecontrol panel 135 and the remote computing device 140 via server 155. Inalternate cases, the network 125 may be integrated with any one of thelocal computing device 115, 120, server 155, or remote computing device140, such that separate components are not required.

Local computing device 115, 120 and remote computing device 140 may becustom computing entities configured to interact with sensor units 110via network 125, and in some cases, via server 155. In other cases,local computing device 115, 120 and remote computing device 140 may begeneral purpose computing entities such as a personal computing device,for example, a desktop computer, a laptop computer, a netbook, a tabletpersonal computer (PC), a control panel, an indicator panel, amulti-site dashboard, an iPod®, an iPad®, a smartphone, a mobile phone,a personal digital assistant (PDA), and/or any other suitable deviceoperable to send and receive signals, store and retrieve data, and/orexecute modules.

Control panel 135 may be a smart home system panel, for example, aninteractive panel mounted on a wall in a user's home. Control panel 135may be in direct communication via wired or wireless communication links145 with the one or more sensor units 110, or may receive sensor datafrom the one or more sensor units 110 via local computing devices 115,120 and network 125, or may receive data via remote computing device140, server 155, and network 125.

The control panel 135 and the local computing devices 115, 120 mayinclude memory, a processor, an output, a data input and a communicationmodule. The processor may be a general purpose processor, a FieldProgrammable Gate Array (FPGA), an Application Specific IntegratedCircuit (ASIC), a Digital Signal Processor (DSP), and/or the like. Theprocessor may be configured to retrieve data from and/or write data tothe memory. The memory may be, for example, a random access memory(RAM), a memory buffer, a hard drive, a database, an erasableprogrammable read only memory (EPROM), an electrically erasableprogrammable read only memory (EEPROM), a read only memory (ROM), aflash memory, a hard disk, a floppy disk, cloud storage, and/or soforth. In some cases, the local computing devices 115, 120 may includeone or more hardware-based modules (e.g., DSP, FPGA, ASIC) and/orsoftware-based modules (e.g., a module of computer code stored at thememory and executed at the processor, a set of processor-readableinstructions that may be stored at the memory and executed at theprocessor) associated with executing an application, such as, forexample, receiving and displaying data from sensor units 110.

The processor of the local computing devices 115, 120 may be operable tocontrol operation of the output of the local computing devices 115, 120.The output may be a television, a liquid crystal display (LCD) monitor,a cathode ray tube (CRT) monitor, speaker, tactile output device, and/orthe like. In some cases, the output may be an integral component of thelocal computing devices 115, 120. Similarly stated, the output may bedirectly coupled to the processor. For example, the output may be theintegral display of a tablet and/or smart phone. In some cases, anoutput module may include, for example, a High Definition MultimediaInterface™ (HDMI) connector, a Video Graphics Array (VGA) connector, aUniversal Serial Bus™ (USB) connector, a tip, ring, sleeve (TRS)connector, and/or any other suitable connector operable to couple thelocal computing devices 115, 120 to the output.

The remote computing device 140 may be a computing entity operable toenable a remote user to monitor the output of the sensor units 110. Theremote computing device 140 may be functionally and/or structurallysimilar to the local computing devices 115, 120 and may be operable toreceive data streams from and/or send signals to at least one of thesensor units 110 via the network 125. The network 125 may be theInternet, an intranet, a personal area network, a local area network(LAN), a wide area network (WAN), a virtual network, atelecommunications network implemented as a wired network and/orwireless network, etc. The remote computing device 140 may receiveand/or send signals over the network 125 via wireless communicationlinks 145 and server 155.

In some cases, the one or more sensor units 110 may be sensorsconfigured to conduct periodic or ongoing automatic measurements relatedto smart sensing. Each sensor unit 110 may be capable of sensingmultiple resource parameters, or alternatively, separate sensor units110 may monitor separate resource parameters. For example, one sensorunit 110 may measure temperature, while another sensor unit 110 (or, insome cases, the same sensor unit 110) may detect motion. In some cases,one or more sensor units 110 may additionally monitor alternate sensorparameters, such as audio, vibrations, inventory.

Data gathered by the one or more sensor units 110 may be communicated tolocal computing device 115, 120, which may be, in some cases, athermostat or other wall-mounted input/output smart home display. Inother cases, local computing device 115, 120 may be a personal computeror smart phone. Where local computing device 115, 120 is a smart phone,the smart phone may have a dedicated application directed to collectingsensor data and calculating predictions therefrom. The local computingdevice 115, 120 may process the data received from the one or moresensor units 110 to obtain prediction of smart sensing. In alternatecases, remote computing device 140 may process the data received fromthe one or more sensor units 110, via network 125 and server 155, toobtain prediction of smart sensing. Data transmission may occur via, forexample, frequencies appropriate for a personal area network (such asBLUETOOTH® or IR communications) or local or wide area networkfrequencies such as radio frequencies specified by the IEEE 802.15.4standard.

In some cases, local computing device 115, 120 may communicate withremote computing device 140 or control panel 135 via network 125 andserver 155. Examples of network 125 include cloud networks, local areanetworks (LAN), wide area networks (WAN), virtual private networks(VPN), wireless networks (using 802.11, for example), and/or cellularnetworks (using 3G and/or LTE, for example), etc. In someconfigurations, the network 125 may include the Internet. In some cases,a user may access the functions of local computing device 115, 120 fromremote computing device 140. For example, in some cases, remotecomputing device 140 may include a mobile application that interfaceswith one or more functions of local computing device 115, 120.

The server 155 may be configured to communicate with the sensor units110, the local computing devices 115, 120, the remote computing device140 and control panel 135. The server 155 may perform additionalprocessing on signals received from the sensor units 110 or localcomputing devices 115, 120, or may simply forward the receivedinformation to the remote computing device 140 and control panel 135.

Server 155 may be a computing device operable to receive data streams(e.g., from sensor units 110 and/or local computing device 115, 120 orremote computing device 140), store and/or process data, and/or transmitdata and/or data summaries (e.g., to remote computing device 140). Forexample, server 155 may receive a stream of sensor data from a sensorunit 110, a stream of sensor data from the same or a different sensorunit 110, and a stream of sensor data from either the same or yetanother sensor unit 110. In some cases, server 155 may “pull” the datastreams, e.g., by querying the sensor units 110, the local computingdevices 115, 120, and/or the control panel 135. In some cases, the datastreams may be “pushed” from the sensor units 110 and/or the localcomputing devices 115, 120 to the server 155. For example, the sensorunits 110 and/or the local computing device 115, 120 may be configuredto transmit data as it is generated by or entered into that device. Insome instances, the sensor units 110 and/or the local computing devices115, 120 may periodically transmit data (e.g., as a block of data or asone or more data points).

The server 155 may include a database (e.g., in memory) containingsensor data received from the sensor units 110 and/or the localcomputing devices 115, 120. Additionally, as described in further detailherein, software (e.g., stored in memory) may be executed on a processorof the server 155. Such software (executed on the processor) may beoperable to cause the server 155 to monitor, process, summarize,present, and/or send a signal associated with resource usage data.

The control panel 135 may monitor a parameter of a resource associatedwith a structure. The resource may include a service or a product. Theservice may be a structure management service or a personal servicerelated to an individual associated with the structure. The structuremanagement service may include at least one of a gardening and lawn careservice, an internet-provider service, a housekeeping service, a laundryservice, a plumbing service, a maintenance service, a termite and pestcontrol service, a water softener service, or any combination thereof.The personal service may include at least one of a babysitting service,a nursing care service, a pet sitting service, a medical provider visitservice, or any combination thereof.

In some cases, monitoring the parameter of the resource may includereceiving real-time usage data of the resource from a sensor unit 110,and tracking real-time usage data based on the usage data. In somecases, the control panel 135 may perform a function based on trackingthe real-time usage data. The function may be performed automaticallybased on a pre-configured setting of the security and automation system.The control panel 135 may predict a future change in conditionassociated with the parameter based on the monitoring.

In some cases, the control panel 135 in conjunction with the server 155or the local computing devices 115, 120 may identify the service or theproduct, or both, and retrieve from a database, historical usage dataassociated with the service or the product, or both based on theidentifying. The control panel 135 may compare the retrieved historicalusage data with the real-time usage data to compute a usage model. Inthis case, the control panel 135 may predict the future change incondition associated with the parameter based on the usage model.

In some cases, the control panel 135 may identify schedule data of anindividual associated with the structure, and automatically schedule aservice personnel to visit the structure and perform an actionassociated with the service based on the schedule data of theindividual. In some cases, automatically scheduling the servicepersonnel may include the control panel 135 identifying a serviceprovider associated with the service based on a pre-configured setting,and transmitting, to the remote computing device 140 of the serviceprovider, a message indicating a service request. The message may atleast one of a payment information, a geolocation information of thestructure, a contact information of the individual, or any combinationthereof. The control panel 135 may receive, from the remote computingdevice 140, an acknowledgment message in response to the servicerequest.

The control panel 135 may detect the service personnel based on sensordata received from one or more of the sensor units 110, and identify atime associated with the detecting. The control panel 135 may comparethe identified time to a scheduled service time, and validate that theidentified time is within a threshold limit of the scheduled servicetime. The control panel 135 may provide, to a device of the servicepersonnel, access information to the structure based at least on thevalidating. The access information may include at least one of a randomcode, a personal identification number (PIN), or instructions forproviding the service to a designated zone of the structure, or anycombination thereof. For example, the function performed by the controlpanel 135 may include providing the access information. The controlpanel 15 may operate a garage door opener based on the validating.

In some cases, the control panel 135 may determine that the product is aconsumable item, identify a consumption rate of the consumable itembased on a consumption model of the consumable item, and automaticallyrequest a purchase order with a third-party enterprise to restock anddeliver the consumable item to the structure. The consumable item may beat least one of food or beverages, or both.

In some cases, the control panel 135 may determine that the product isan apparatus or a household item, and identify a usage rate of theapparatus or the household item based on a usage model of the apparatusor the household item. In some cases, the control panel 135 mayautomatically request a purchase order or a maintenance order with athird-party enterprise to restock and deliver the household item to thestructure or provide a maintenance service of the apparatus.

In some cases, the local computing device 115, 120, or the remotecomputing device 140, or the control panel 135 may establish aconnection with the apparatus, and retrieve specification informationassociated with the apparatus based on performing a scan using theestablished connection. The specification information may includewarranty coverage information, appliance repair and support information,vendor information, an energy consumption and cost report of operatingthe apparatus, or any combination thereof.

Benefits of the system 100 include smart sensing, by enabling thecontrol panel 135 in communication with the one or more sensor units110, the local computing device 115, 120, and/or the remote computingdevice 140 to intelligently monitor, predict, and automatically and/orautonomously handle resources of a smart home. Thereby improving theoperating characteristics of the control panel 135 (e.g., managing CPUand memory usage levels, reducing latency, decreasing powerconsumption), because the control panel 135 by periodically receivingand/or pulling data from one or more devices (e.g., sensor units 110)and using predication models regulate other smart devices in the smarthome with reduced processing requirements (e.g., CPU usage).

FIG. 2A illustrates an example diagram relating to an example securityand automation environment 200-a that supports smart sensing techniquesin accordance with aspects of the present disclosure. In some examples,the security and automation environment 200-a may implement aspects ofthe system 100. The security and automation environment 200-a mayinclude one or more sensor units 210 and one or more access points 215and 220. For example, the access points 215 may include windows of asmart home 250, and the access points 220 may include an entrance doorto the smart home 250. In some examples, an access point of the smarthome 250 may include one or more garage doors. The one or more sensorunits 210 may be installed, mounted, or integrated with one or more ofthe access points 215 and 220, or alternatively with an interior and/oran exterior surface of the smart home 250.

The security and automation environment 200-a may support smart sensingof a lawn 230-a related to the smart home 250. By providing smartsensing of the lawn 230-a, the control panel 135 may predict futureconditions of the lawn 230-a. Based on the future condition (i.e.,whether the lawn 230-a will be in a satisfactory or unsatisfactorystate), the control panel 135 may provide suggested solutions to anindividual or perform functions automatically to mitigate or eliminatethe future condition from occurring.

The control panel 135 may be located within the smart home 250. Thecontrol panel 135 may receive data from the one or more sensor units 210that may be installed, mounted, or integrated with an exterior surfaceof the smart home 250. In some examples, the control panel 135 maycommunicate and receive data periodically or continuously from thesensor units 210. The control panel 135, the one or more sensor units210, and a sensor unit 225 may communicate according to a radio accesstechnology (RAT) such as 5G New Radio (NR) RAT, Long Term Evolution(LTE), Institute of Electrical and Electronics Engineers (IEEE) 802.11(Wi-Fi), IEEE 802.16 (WiMAX), near-filed communication (NFC), ZigBeeprotocol, among others.

The one or more sensor units 210 may be same or different sensorsconfigured to conduct continuous or discontinuous measurements of thelawn 230-a. In some cases, to improve the operating characteristics(e.g., power consumption, central processing unit (CPU) usage, memoryusage) of the control panel 135, the one or more sensor units 210 may beconfigured by the control panel 135 to transmit data related to the lawn230-a, periodically. For instance, periodic transmissions may include asensor unit 210 transmitting sensor data to the control panel 135 everyn hours, days, or weeks, where n is a positive integer.

For example, a sensor unit 210 may transmit a set of recorded sensordata to the control panel 135 every 4 hours. The control panel 135 mayalso be configured with a transmission schedule of the one or moresensor units 210. As a result, the control panel 135 may switch to a lowpower state when no transmission is occurring, i.e., between the controlpanel 135 and the one or more sensor units 210, to conserve powerconsumption and computing resources. For example, the control panel 135may transition between an awake state and a sleep state based on thetransmission schedule. By implementing multiple operating states for thecontrol panel 135 such as an awake state and a sleep state, the controlpanel 135 may operate with a higher efficiency with respect to power,computing, and storage resources.

In some cases, as part of configuring the one or more sensor units 210with the control panel 135, each sensor unit 210 may establish aconnection with the control panel 135. For example, each sensor unit 210may during initialization broadcast a beacon signal to the control panel135. Additionally, the control panel 135 itself may broadcast a beaconsignal to indicate its presence to the one or more sensor units 210. Thebeacon signal may include configuration information for the one or moresensor units 210 to configure and synchronize with the control panel135. In some cases, the beacon signal broadcasted from each sensor unit210 may include registration information. The registration informationmay include specification information and a unique identifier (e.g.serial number) identifying each sensor unit 210. The specificationinformation may include warranty coverage information, repair andsupport information, vendor information, an energy consumption and costreport of operating a sensor unit 210, or any combination thereof.

The control panel 135 may store the registration information in a localmemory or remotely (e.g., in a remote database). In some cases, based onthe size of the registration information, the control panel 135 maydetermine to save a copy of a portion of the registration information(e.g., serial number of each sensor unit 210) in local memory and savethe full registration information in a remote database. The local memorymay be a relational database. The relational database may include atable that may have a set of data elements (e.g., sensor information).For example, the table may include a number of columns, and a number ofrows. Each row may be associated with a sensor unit 210, and each columnmay include information (e.g., sensor values, timestamps for sensordata, status indicators (e.g., a power, a failure, or a maintenanceindicator)) associated with each sensor unit 210. In some examples, theremote database may also be a relational database.

The smart home 250 may be associated with a subscription service. Asubscription service may, for example, include a security service andthe control panel 135 may be part of the security service. For example,the control panel 135 may be the property of the security service. Thecontrol panel 135 may communicate received sensor data to a serverassociated with the security service. For example, the server 155 mayhost the security service, and the control panel 135 may forward data(e.g., sensor data, registration information, account information,scheduled services, etc.) to the server 155. In some cases, some or allof the functions described herein may be performed at the server 155.Alternatively, the control panel 135 may be the property of theindividual associated with the smart home 250. In this case, theindividual may install and register an application related to thesecurity service onto the control panel 135. The individual thereforemay access, modify, monitor, features of the security service via theapplication. The application may upload and download sensor-related datato and from the server 155.

In some cases, the smart home 250 may be a member of a smartneighborhood. The smart neighborhood may include a cluster of smarthomes that may share resources amongst each other. For example, a remotedatabase may be a local memory of a neighboring smart home. The smarthome 250 may therefore transmit sensor data to the neighboring smarthome for storage. In the case that the smart neighborhood is associatedwith a security service, each smart home of the neighborhood may besubscribed with the security service. For example, to transmit sensordata for storing at a neighboring home, both the smart home and theneighboring home may have to be subscribed with the same securityservice. The security service may provide security transmissionprotocols to mitigate possibility of data being compromised duringexchange between two or more smart homes. A security transmissionprotocol may be a wireless protected access (WPA), WPA2, among others.In some examples, the control panel 135 may communicate with one or moreof the sensor units 210 using the security transmission protocol.

With reference to the lawn 230-a, the lawn 230-a may be a single zone ormay be separated into multiple subzones (not shown). The control panel135 may automatically configure a zone or two or more subzones for thelawn 230-a based on a dimension of the lawn 230-a and a number of sensorunits 210 monitoring the lawn 230-a. For example, the control panel 135may receive a snapshot of the lawn 230-a. For example, a drone (e.g., asensor unit 210 or the sensor unit 225) may capture an aerial snapshotof the smart home 250 including the lawn 230-a. In addition, to theaerial snapshot, the drone may be configured with laser scanningtechniques to measure a dimension of the lawn 230-a. The snapshot andthe measured dimension may be transmitted to the control panel 135. Forexample, a sensor unit 210 or the sensor unit 225 may transmit thesnapshot and the measured dimension to the control panel 135 via anestablished connection (e.g., Wi-Fi connection). The control panel 135may determine to automatically assign a single zone or a number ofsubzones to the lawn 230-a based on the measured dimension. In somecases, the control panel 135 may also be aware of a sprinkler systemconfiguration of the lawn 230-a. That is, the control panel 135 mayidentify locations (e.g., positions, coordinates) of sprinkler nodesacross the lawn 230-a. In this case, the control panel 135 may alsoconsider assignment of the zone or the subzones based on the sprinklersystem configuration (i.e., the number of sprinkler nodes installedacross the lawn 230-a).

The control panel 135 may provide a visualization of the smart home 250including the lawn 230-a via an application running on the control panel135. To identify the lawn 230-a, the control panel 135 may perform imageprocessing techniques on the captured snapshot. For example, the controlpanel 135 may load and provide for display, via a user interface of thecontrol panel 135, the captured snapshot and the measured dimension ofthe lawn 230-a. In some cases, assigning a zone or two or more subzonesmay be provided manually by an individual (e.g., administrator). Theindividual may assign a zone or a number of subzones to the lawn 230-avia an application. For example, the individual may assign at least oneof the sensor units 210 to a single zone or assign to each subzone atleast one sensor unit using an application installed on the controlpanel 135. The control panel 135 may receive the assignment via a userinterface or an input device (e.g., a keyboard, a mouse, a stylus) ofthe control panel 135. In some cases, the control panel 135 may receivethe assignment from the local computing device 115 or 120, or the remotecomputing device 140. The local computing device 115 or 120, or theremote computing device 140 may access the control panel 135 remotely toperform an operation (e.g., zone assignment, check a status of the smarthome 250, or the lawn 230-a).

A sensor unit 210 may be inserted into the ground of the lawn 230-a.Each sensor unit 210 may be capable of sensing multiple parametersassociated with the lawn 230-a, or alternatively, separate sensor units210 may monitor separate parameters. For example, one sensor unit maymeasure a humidity (i.e., moisture level) associated with the soil ofthe lawn 230-a, while another sensor unit may monitor a temperatureassociated with the soil. The one or more sensor units 210 may alsomonitor a soil salinity, soil pH, external temperature, and externalhumidity associated with the lawn 230-a.

In some cases, a sensor unit 225 may be a camera that monitors thestatus of the lawn 230-a. For example, the sensor unit 225 may capturean image or a video of the lawn 230-a. In some examples, the sensor unit225 may be a drone with a camera, or the sensor unit 225 may be a camerathat is mounted, installed, or configured to an exterior surface of thesmart home 250. In the case that the sensor unit 225 is a drone with acamera or a standalone camera, the camera may be configured to captureaerial snapshots of the lawn 230-a. In some examples, the camera may bea wide-angle camera having a field-of-view which may cover a portion orall of the lawn 230-a. The camera may also have pan/tilt or zoomcapabilities. In some examples, the camera may be a narrow-field-of-viewcamera compared to the wide-angle camera, to monitor a portion (e.g., asubzone) of the lawn 230-a.

The sensor unit 225 may also monitor light conditions relative to thelawn 230-a. For example, the sensor unit 225 may be a thermal camerathat may capture thermal images of the lawn 230-a. Using the capturedthermal images the sensor unit 225 may track and record a temperatureand exposure time of the lawn 230-a to light (e.g., sunlight). In somecases, the control panel 135 may determine a geolocation (e.g., latitudeand longitude) of the smart home 250, and request weather data from aweather service via a server (e.g., the server 155). Using the weatherdata and geolocation of the smart home 250, the control panel 135 mayimprove providing smart sensing and processing of the received sensordata from the one or more sensor units 210 and the sensor unit 225 bycorrelating the weather data with the received sensor data to determinea status of the lawn 230-a. A status of the lawn 230-a may indicatewhether the lawn 230-a is nourished or necessitates attention (e.g.,watering).

The one or more sensor units 210 and the sensor unit 225 may timestampsensor data. In some cases, the sensor data may also include metadata.For example, the metadata may correlate the sensor data with a sensorunit 210 or 225. The one or more sensor units 210 and the sensor unit225 may transmit the sensor data (e.g., captured images or video,temperature, humidity, light, vibration) associated with the lawn 230-ato the control panel 135. The control panel 135 may receive the sensordata and perform post-processing. For example, the control panel 135 mayanalyze the sensor data to determine a status of the lawn 230-a.

Analysis of the sensor data may include the control panel 135 comparingthe received sensor data to historical sensor data of the lawn 230-a.The historical sensor data may be flagged with indicators that identifya status of the lawn 230-a in a previous period. For example, historicalsensor data may include a captured image that may have pixel indicatorsidentifying an area of the lawn 230-a that was unattended (e.g., weedsgrowing, a section of the lawn 230-a that has low levels of humidity,etc.). The control panel 135 may perform image processing andrecognition techniques that may correlate the received sensor data withthe historical sensor data to identify a correlation.

In some cases, the control panel 135 may predict a future change in thestatus of the lawn 230-a. For example, the control panel 135, inresponse to correlating the received sensor data with the historicalsensor data, may determine that the lawn 230-a is in a satisfactorystate. However, as part of the analysis and correlation, the controlpanel 135 may identify a section of the lawn 230-a that may have acharacteristic that may be similar to historical sensor data of the lawn230-a. For example, a section of the lawn 230-a may on average have alower humidity level or a higher temperature reading compared to theremainder sections of the lawn 230-a. This may be in an indicator thatthe section of the lawn 230-a with a higher temperature reading and alower humidity level is receiving less nutrition compared to othersections of the lawn 230-a. As a result, this section may requireattention at a subsequent time. For example, the control panel 135 mayestimate that the section of the lawn 230-a may further deterioratebased on received forecasted weather data from the server 155, and thesensor data. The control panel 135 may flag this for an individual bysending a notification or may automatically perform a function tomitigate the risk of the section of the lawn 230-a becoming worse.

FIG. 2B illustrates an example diagram relating to an example securityand automation environment 200-b that supports smart sensing techniquesin accordance with aspects of the present disclosure. In some examples,the security and automation environment 200-b may implement aspects ofthe security and automation environment 200-a. With reference to FIG.2B, the control panel 135 may determine that patches 235 of lawn 230-ahave a status indicating an unsatisfactory state. Patches 235 mayinclude a section of the lawn 230-a that may have weeds growing, or asection of grass that is malnourished (e.g., under watered). Returningto the analysis of the sensor data, the control panel 135 may performmachine learning to determine the status of the lawn 230-a.

For example, the control panel 135 may have a set of training sensordata. The training sensor data may be reflective of a status of the lawn230-a that indicates the lawn 230-a is nourished. The control panel 135may process the received sensor data with the historical sensor data andthe set of training sensor data to determine a future status of the lawn230-a. For instance, the control panel 135 may identify the patches 235as a result of performing the machine learning. In this cases, thepatches 235 may be indicate of a future condition of the lawn 230-a, andmay have not yet occurred. The control panel 135 may support at leastone of the following machine learning techniques including: vectormachines, decision trees, Naïve Bayes classification, ordinary leastsquares regression, or logistic regression, to predict the future changein the condition of the lawn 230-a.

In some cases, the control panel 135 may confirm a determined status ofthe lawn 230-a by performing additional analysis using different typesof sensor data related to the lawn 230-a. For example, a first sensordata analysis may include the captured images (e.g., thermal imaging) ofthe lawn 230-a by the sensor unit 225, while a second sensor dataanalysis may include recorded sensor data (e.g., soil moisture, soiltemperature) by the one or more sensor units 210. In an example, if boththe first and the second sensor data analysis indicates that the lawn230-a is unnourished, the control panel 135 may confirm that the statusof the lawn 230-a is in an unsatisfactory state. The control panel 135may transmit a notification to a device of an individual indicating thestatus of the lawn 230-a.

FIG. 3A illustrates an example of a wireless device 300 that supportssmart sensing techniques in accordance with aspects of the presentdisclosure. The wireless device 300 may be a smartphone 305. Thewireless device 300 may also be the control panel 135, or the localcomputing devices 115 or 120, or the remote computing device 140 asdescribed in FIGS. 1 and 2. The smartphone 305 may include a userinterface 310. The user interface 310 may be a touch screen that maydisplay one or more graphics, and recognize a touch from an individual,stylus, or the like. The smartphone 305 may also include one or morephysical buttons 312.

The control panel 135 may transmit a notification message to thesmartphone 305. The smartphone 305 may receive and display thenotification message via dialogue window 315 on a home screen of theuser interface 310. The home screen may include a number of visualelements associated with the user interface 310. For example, a visualelement may include a signal strength indicator for wirelesscommunications, a time, and a battery status indicator. In some cases,the notification message may be preprogrammed with the control panel135. That is, the control panel 135 may be preconfigured with a numberof pre-generated messages that may be communicated or broadcasted (e.g.,from the control panel 135). The notification message may provide anindividual with a pre-generated notification message associated with thelawn 230-a. For example, the notification message may state a messagesuch as “Your lawn has a problem. Deal with it.” The individual mayignore, respond, or acknowledge the notification message by makingcontact or touching the user interface 310, for example, with one ormore fingers of the individual's hand 325. In some cases, the userinterface 310 may be configured to recognize any number of differenttypes of inputs.

For instance, an individual may tap the user interface 310 to select acorresponding option. Further inputs recognized by the user interface310 may include multiple, simultaneous touches of the user interface 310and/or gestures. Gestures may generally include a touch of the userinterface 310 (e.g., a touch-point), optionally accompanied by acorresponding movement of the finger, stylus or other element touchingthe user interface 310. Gestures may be combined with multipletouch-points or may be used with a single touch-point of the userinterface 310. In some cases, multiple touch-point and gesture inputsmay be recognized by the user interface 310. For example, an individualmay use their hand to touch the user interface 310 at two touch-points.Upon touching the user interface 310, the individual may then move theirfingers in a predetermined manner recognizable by the smartphone 305(e.g., using a gesture recognition application as part of an operatingsystem or as a separate application of the smartphone). When multipletouch-points and gestures are detected, the smartphone 305 may recognizethe gesture, identify an action associated with the gesture, and performthe action. For example, the action may be to ignore or respond to thenotification message.

In some examples, the dialogue window 315 may be a modal dialog windowthat may force the individual associated with the smartphone 305 tointeract with the notification message before allowing the individual toreturn to using other features (e.g., applications, messaging, calling)of the smartphone 305. The notification message may also provideadditional information. To view the additional information, theindividual may select the “Press for more” option 320 within thedialogue window 315.

FIG. 3B illustrates an example of a wireless device 300 that supportssmart sensing techniques in accordance with aspects of the presentdisclosure. In the example of FIG. 3, the user interface 310 maytransition out of a home screen and display one or more additionalwindows (e.g., dialogue windows or modal windows). In some cases,additional, different or fewer buttons may be provided, or differenttypes of inputs may be provided on the user interface 310. For example,a tray 348 may display icons of frequently used applications. After theindividual selects the option 320 to view additional information, theuser interface 310 may display the additional information in a dialoguewindow 330.

The additional information may include one or more options for theindividual to respond to the notification message. For example, a firstoption 335 may be a “Yes, please” selection, a second option 340 may bea “No, thanks” selection, and a third option 345 may be a “Cancel”choice. If the individual selects the second option 340, the smartphone305 may communicate the selection to the control panel 135. The controlpanel 135 may receive the selection and continue normal routineoperation (e.g., enter a low power state, receive sensor data). Thecontrol panel 135 may also record the selection and use it to model aresponse pattern for the individual. Alternatively, if the individualselects the third option 345, the control panel 135 may receive andrecord the selection for modeling the response pattern. In some cases,the third option 345 may prompt the control panel 135 to transmit areminder notification message to the smartphone 305. For example, thethird option 345 may act as a snooze choice, and the control panel 135may transmit the reminder notification message after an expiration of apredetermined period. The predetermined period may be selected by theindividual or be a preconfigured system setting of the control panel135. Alternatively, if the individual selects the first option 335, thedialogue window 315 may display different information.

FIG. 3C illustrates an example of a wireless device 300 that supportssmart sensing techniques in accordance with aspects of the presentdisclosure. In the example of FIG. 3C, the dialogue window 315 maydisplay one or more selectable options for the individual. A firstoption 350 may include recommend options suggested by the control panel135 (e.g., suggested by the home automation system), a second option 355may include a choice to view a snapshot of the lawn 230-a, and a thirdoption 360 may include an option to view a time-lapse of the lawn 230-a.

With reference to FIG. 2B, the control panel 135 may determine a set ofrecommended actions to perform based on the determined status of thelawn 230-a. The control panel 135 may identify a learned preference or apre-stored setting of the individual, to determine the set ofrecommended actions. For example, the control panel 135 may analyzehistorical data related to actions taken by the individual with respectto the lawn 230-a. The recommended actions may include adjusting one ormore parameters of or controlling a sprinkler system, identifying aproduct (e.g., fertilizer) that may provide a solution to the patches235, or suggest scheduling an appointment with a gardening and lawn careservice, among others. If the individual selects the first option 350,the dialogue window 315 may display additional information or selectionsfor the individual.

FIG. 3D illustrates an example of a wireless device 300 that supportssmart sensing techniques in accordance with aspects of the presentdisclosure. After the individual selects the first option 350, thedialogue window 315 may display one or more selectable options for theindividual. A first option 365-a may include an option to adjust one ormore sprinkler system parameters and a second option 365-b may includean option to schedule a service appointment. In some cases, the controlpanel 135 may determine the severity of the patches 235. For example,the control panel 135 may determine whether the patches 235 may bereplenished to a normal status by providing frequent watering of thepatches 235. If the control panel 135 determines that the patches can beimproved using the sprinkler system, the control panel 135 mayautomatically modify one or more parameters of the sprinkler system toprovide the desired result (i.e., improvement of the patches 235).

A parameter of the sprinkler system may include a run time for asprinkler zone associated with the lawn 230-a. In some examples, thesprinkler system may be intelligent with respect that the control panel135 may modify a parameter of one or more sprinkler nodes withoutaffecting operation of other sprinkler nodes of the sprinkler system.The control panel 135 may transmit a message requesting approval toadjust a parameter of the sprinkler system. For example, the controlpanel 135 may transmit to a device (e.g., smartphone 305) a request forauthorization to perform the adjustment. The control panel 135 mayreceive, from the device, an acknowledgment message in response to thetransmitted request. As a result, the control panel 135 may modify aparameter of the sprinkler system. Alternatively, the control panel 135may automatically perform the adjustment without requestingauthorization from the individual.

In some cases, the control panel 135 may determine that the lawn 230-amay require servicing (i.e., mowed, weeds pulled) based on the sensordata. In this case, the control panel 135 may identify a learnedpreference or a pre-stored setting of the individual with respect to thelawn 230-a. For example, the learned preference or the pre-storedsetting may indicate to contact a lawn care service (i.e., third-partyenterprise). As such, the control panel 135 may parse and retrievecontact information associated with the lawn care service via adatabase. In some cases, the control panel 135 may identify one or morelawn care services and transmit a message to the smartphone 305 for theindividual to select a lawn care service. To identify a lawn careservice, the control panel 135 may communicate with one or morethird-party servers (e.g., the server 155, or a search engine server).The control panel 135 may communicate one or more search parameters tothe third-party server. For example, the control panel 135 may provide ageolocation of the smart home 250, a search radius associated with thegeolocation, a service category (i.e., lawn care service), among others.In some cases, the third-party server may provide a list of identifiedlawn care services based on the provided search parameters.

The control panel 135 may provide the list to the smartphone 305 forviewing by the individual. The control panel 135 may receive a selectionof a lawn care service from the individual via the smartphone 305. Oncethe control panel 135 receives a selection of the lawn care service; orin the case the control panel 135 has a learned preference or apre-stored setting of a previously used lawn care service, the controlpanel 135 may generate a message and transmit it to the lawn careservice (e.g., to a server associated with the lawn care service). Insome examples, the message may include a request to schedule a personnelto visit the smart home 250 to provide the service during a specifieddate and time. The schedule may be based on a schedule of the individualassociated with the smart home 250. The message may also include addressinformation associated with the smart home 250. The message may be ane-mail, or an automatic request form filled on a website of the lawncare service, an SMS, etc.

In some cases, the control panel 135 may refrain from transmitting themessage until receiving authorization from the individual. In somecases, scheduling the lawn care service may include providing paymentinformation. The control panel 135 may be configured with one or morepayments options. For example, an individual may store credit cardinformation with the control panel 135. As such, transmitting themessage to the individual for authorization may include requesting theindividual to authorize payment and scheduling of the lawn care servicevia their personnel device (e.g., smartphone 305). The control panel 135may also provide the payment information in the message transmitted tothe lawn care service.

The control panel 135 may receive a reply message from the lawn careservice confirming the request. In some cases, the control panel 135 maytransmit a notification message to the smartphone 305 notifying theindividual of the scheduled lawn care service. In some cases, thecontrol panel 135 may track a pending status of the scheduled lawn careservice, and provide notifications to the individual when the status isdetermined to be completed. In some examples, the control panel 135 mayautomatically schedule the lawn care service based on a predeterminedsetting (e.g., preapproval by the individual).

With reference to FIG. 3C, if the individual selects the second option355, the dialogue window 315 may display additional information ordifferent options for the individual. FIG. 3E illustrates an example ofa wireless device 300 that supports smart sensing techniques inaccordance with aspects of the present disclosure. In the example ofFIG. 3E, the dialogue window 315 may display a snapshot 370 of the smarthome 250 including the lawn 230-a and the patches 235. In addition tothe snapshot 370, the dialogue window 315 may also display additionalinformation 375. The displayed additional information 375 may include atimestamp of the snapshot 370, sensor data (e.g., a humidity levelsensed by a humidity sensor), and a status (e.g., ON/OFF) of a sprinklersystem.

With reference to FIG. 3C, if the individual selects the third option360, the dialogue window 315 may display additional information ordifferent options for the individual. FIG. 3F illustrates an example ofa wireless device 300 that supports smart sensing techniques inaccordance with aspects of the present disclosure. In the example ofFIG. 3F, the dialogue window 315 may display a time-lapse 380 of thesmart home 250. An individual may scan across different frames using thetime-lapse visualizer 385-a or the time-lapse marker 385-b. In someexamples, the control panel 135 may generate a time-lapse video ofsensor data (e.g., captured images or video) based on analysis points oractivity of interest related to one or more attributes. An attribute mayinclude detection of change or transition of color or luminance. Thecontrol panel 135 may detect a change or a transition of color orluminance between video frames, color or luminance can be detected basedon changes across video frames, such as a pair of consecutive videoframes. The control panel 135 may flag video frames where change incolor and luminance is detected, as such the time-lapse 380 may be acondensed data file (i.e., video). An individual may determine how torespond to the notification message provided by the control panel 135based on the snapshot 370 or the time-lapse 380.

FIG. 4 illustrates an example diagram relating to an example securityand automation environment 400 that supports smart sensing techniques inaccordance with aspects of the present disclosure. In some examples, thesecurity and automation environment 400 may implement aspects of thesecurity and automation environment 200-a and 200-b. The security andautomation environment 400 may include one or more sensor units 210 andthe sensor unit 225 as described with reference to FIGS. 2A and 2B. Theone or more sensor units 210 or the sensor unit 225 may detect that aperson 440 is located within a distance threshold to the smart home 250.The one or more sensor units 210 or the sensor unit 225 may also detecta vehicle 445. The one or more sensor units 210 or the sensor unit 225may transmit sensor data indicating the detected person 440 to thecontrol panel 135. The sensor data may include sensed motion at or nearthe smart home 250, sensed sound at or near the smart home 250, sensedactivation of a doorbell at or near an entry to the smart home 250, oran image of the detected person 440 and the vehicle 445.

The control panel 135 may receive and perform post-processing on thesensor data. For example, the control panel 135 may perform imagerecognition (e.g., facial recognition) on a captured image of thedetected person 440. If a face is detected, processing the capturedimages may include determining who the person 440 is, whether the person440 is on an approved list of visitors (e.g., an approved servicepersonnel list), or the like. Recognition may include detecting otheraspects. For instance, if the person 440 is there to perform the lawncare service, an insignia, symbol, or the like on the person's 440clothing may be detected to identify the lawn care service. In somecases, the control panel 135 may perform image recognition techniques onthe captured image of the vehicle 445 to identify a symbol on thevehicle 445 that may identify the lawn care service. In some cases, thecontrol panel 135 may receive a message from a personnel device carriedby the person 440. The message may indicate that the person has arrivedat the smart home 250 to perform the lawn care service. The message mayalso include identification information with respect to an identity ofthe person 440 and the lawn care service.

In some cases, the control panel 135 may identify a timestamp (e.g.,time and date) associated with the sensor data indicating the detectionof the person 440. The control panel 135 may compare the timestamp to ascheduled service time. The control panel 135 may validate that thetimestamp is within a threshold limit of the scheduled service time. Insome cases, the control panel 135 may transmit a notification to adevice (e.g., smartphone 305) of an individual associated with the smarthome 250 indicating arrival of the person 440. The control panel 135 mayalso track a duration of the person 440 at a premises of the smart home250 and an activity level of the person 440 with respect to performingthe requested service of the lawn 230-a. The control panel 135 maygenerate a report indicating a total duration of the service andtransmit the report to the device (e.g., smartphone 305) of theindividual. In some cases, the control panel 135 may support and providean option for the individual to view a real-time video feed. Forexample, the real-time video feed may show the person 440 servicing thelawn 230-a. The control panel 135 may detect when the person 440 departsthe premises of the smart home 250, and notify the individual of thedeparture.

FIG. 5 illustrates an example diagram relating to an example securityand automation environment 500 that supports smart sensing techniques inaccordance with aspects of the present disclosure. In some examples, thesecurity and automation environment 500 may implement aspects of thesystem 100. In some examples, the security and automation environment500 may implement aspects of the security and automation environment200-a, 200-b, and 400. The security and automation environment 500 mayinclude one or more sensor units 510 and one or more access points 515.For example, the access points 515 may include windows or doors of asmart room 255. The one or more sensor units 510 may be installed,mounted, or integrated with one or more of the access points 515, oralternatively with an interior and/or an exterior surface (e.g., walls,floors) of the smart room 255.

The control panel 135 may be located within the smart room 255. Thecontrol panel 135 may receive data from the one or more sensor units 510that may be installed and mounted with a surface of the smart room 255.The one or more sensor units 510 may be integrated with a home applianceor fixture such as a light bulb fixture. For example, one sensor unitmay be installed and mounted on a wall, a second sensor unit may beinstalled or mounted on a floor. Additionally or alternatively, a thirdsensor unit may be installed or integrated with a light fixture 505. Insome examples, the control panel 135 may communicate and receive dataperiodically or continuously from the sensor units 510. The controlpanel 135, the one or more sensor units 510 may communicate according toa RAT.

The one or more sensor units 510 may represent one or more separatesensors or a combination of two or more sensors in a single sensordevice. For example, the one or more sensor units 510 may be anaccelerometer sensor, an audio sensor, a motion sensor, a capacitancesensor, a camera, a temperature sensor, among others. The security andautomation environment 500 may support smart sensing of a pest within asmart home i.e., the smart room 255. A pest may be any animal that mayexert a harmful effect on an individual associated with the smart room255, or on a consumable item (e.g., food and beverages). For example,pests may include, but are not limited to, cockroaches 520-a, termites520-b, and rodents 520-c.

The one or more sensor units 510 may detect cockroaches 520-a on anexterior or interior surface of a wall or a floor associated the smartroom 255. For example, one sensor unit may be a motion sensor that maydetect movement on the walls, another sensor unit 510 may be a camerathat may capture images or a video within a field-of-view of where thedetected movement is occurring. Both sensor units 510 may transmit thesensor data (i.e., detected movement and captured image(s)) to thecontrol panel 135. The control panel 135 may perform processing on thesensor data to determine or identify who or what is associated with thedetected movement. For example, the control panel 135 may perform imagerecognition techniques or video analytics that may identify and confirmthat an object in an area of the detected movement is an animal asopposed to other types of objects, such as persons.

In some cases, the one or more sensor units 510 may detect the termites520-b on an exterior or interior surface of a wall or a floor associatedthe smart room 255. For example, one sensor unit may be installed,mounted, or integrated with a floor of the smart room 255, and maymonitor and detect vibrations relative to the floor. The sensor unit 510may transmit the sensor data (e.g. detected vibrations) to the controlpanel 135. The control panel 135 may receive and perform processing onthe sensor data to confirm that an anomaly exists on an exterior orinterior surface of the floor. For example, the control panel 135 maycompare the received sensor data to other sensor data (e.g., a sensorunit installed, mounted, or integrated with a wall that may also monitorvibrations), to confirm whether the detected vibrations from the sensorunit 510 is an isolated event or whether it is widespread across thesmart room 255.

The control panel 135 may perform analytics on the received sensor data.Analytics may include the control panel 135 requesting sensor data(e.g., vibration specific data) from a third-party server. The requestmay indicate a type of sensor data, a sensitivity range (e.g.,gravitational sensitivity) of the sensor data, a category (e.g.,earthquake sensor data, residential sensor data, commercial sensor data,animal sensor data). For example, the type may be vibrational sensordata, the range may be of the detected sensor readings (0.5 g), and thecategory may be humans and animals. As a result, the control panel 135may receive the sensor data from the third-party server (e.g., theserver 155). The control panel 135 may then perform analytics bycomparing the received sensor data from one or more of the sensor units510 and the received sensor data from the third-party server. Based onthe comparison, the control panel 135 may eliminate the option that thesensor data is related to humans, and determine that the sensor data isassociated with an animal (i.e., pest).

In some cases, the one or more sensor units 510 may detect the rodents520-c on an exterior or interior surface of a wall or a floor associatedwith the smart room 255. In some examples, a first sensor unit may be atemperature sensor combined with a camera. The sensor unit 510 maymonitor an ambient temperature of the smart room 255, and the camera maybe a thermal camera that may be an infrared sensor for monitoringincreased fluctuations in infrared radiation. A second sensor unit maybe a motion sensor that may detect motion, and a third sensor unit maybe an audio sensor that may detect sounds.

In the example of detecting the rodents 520-c, the second sensor unitmay detect motion and the third sensor unit may detect a sound. Both thesecond and third senor units may transmit the sensor data (i.e.,detected motion and sound) to the control panel 135. The control panel135 may correlate and associate the sensor data from the second senorunit and the third sensor unit based on a timestamp of the sensor dataand the location of the senor units in the smart room 255. As a result,the control panel 135 may perform analytics on a combination of thesensor data from both sensor units. Analytics may include the controlpanel 135 identifying whether the detected sound and motion ishuman-generated or animal-generated. For example, the control panel 135may be configured to distinguish between human speech and animal sounds(e.g., a dog barking), as well as distinguish between human footstepsand animal footsteps (e.g., distinguish between biped footstep patternsand quadruped footstep patterns, etc.). The control panel 135 maytherefore confirm that the detected movement and sound is associatedwith an animal (e.g., rodents 520-c) or a human.

In some cases, the control panel 135 may signal the first sensor unit tocapture images or a video of the smart room 255 including thermal imageswith respect to the interior surface of the walls and floors of thesmart room 255. Alternatively, the first sensor unit may capture imagesand video based on detected increased fluctuations in infraredradiation. The control panel 135 may receive thermal images captured bythe first sensor unit that may further confirm that the detectedmovement and sound is associated with the rodents 520-c. In some cases,the control panel 135 may generate a map of the smart room 255 withrespect to the rodents 520-c. For example, the map may showlocation-related data of the rodents 520-c (e.g., spatial and temporaldata of the movement of the rodents 520-c) with respect to the smartroom 255. The control panel 135 may notify an individual associated withthe smart room 255. For example, the control panel 135 may transmit anotification message alerting the individual of the detected pests. Thenotification message may include the generated map of the smart room 255and location-related data of the rodents 520-c.

FIG. 6A illustrates an example of a wireless device 600 that supportssmart sensing techniques in accordance with aspects of the presentdisclosure. The wireless device 600 may be a smartphone 605. Thewireless device 600 may also be the control panel 135, the localcomputing devices 115,120, or the remote computing device 140 asdescribed in FIGS. 1 through 5. The wireless device 600 may alsoimplement aspects of the wireless device 300. The smartphone 605 mayreceive and display the message received from the control panel 135 viadialogue window 615 on a user interface 610. In some cases, the messagemay be preprogrammed with the control panel 135. That is, the controlpanel 135 may be preconfigured with a number of messages that may becommunicated to the smartphone 605. For example, the message may providean individual with a notification message e.g., “Your home has aproblem. Deal with it.” The individual may disregard or accept thenotification message by touching the user interface 610, for example,with one or more fingers of the individual's hand 625. The notificationmessage may also provide additional information. To view the additionalinformation, the individual may select the “Press for more” option 620within the dialogue window 615.

FIG. 6B illustrates an example of a wireless device 600 that supportssmart sensing techniques in accordance with aspects of the presentdisclosure. In the example of FIG. 6B, the user interface 610 maytransition out of a home screen and display one or more additionalwindows (e.g., dialogue windows or modal windows). In some cases,additional, different or fewer buttons may be provided, or differenttypes of inputs may be provided on the user interface 610. For example,a tray 650 may display icons of frequently used applications. After theindividual selects the option 620 to view additional information, theuser interface 610 may display the additional information in a dialoguewindow 630. The additional information may include one or more optionsfor the individual to respond to the notification message. For example,a first option 635 may be a “Yes, please” decision, a second option 640may be a “No, thanks” selection, and a third option 645 may be a“Cancel” choice, as described with reference to FIG. 3B. In some cases,if the individual selects the first option 635, the dialogue window 315may display different information.

With reference to FIG. 5, in some cases, the control panel 135 mayperform a function associated with the detection of one or more pestsrelative to the smart room 255. For example, the control panel 135 maygenerate one or more suggested options for an individual to select as aresponse action to the detection of the one or more pests. In anexample, the control panel 135 may identify a product or a service forhandling the detected pest.

FIG. 6C illustrates an example of a wireless device 600 that supportssmart sensing techniques in accordance with aspects of the presentdisclosure. In some cases, the control panel 135 may determine a set ofrecommended options based on a learned preference or a pre-storedsetting of the individual. For example, the control panel 135 mayanalyze historical data related to actions taken by the individual withrespect to the detected pests. The dialogue window 615 may display oneor more selectable options for the individual. A first option 655-a mayinclude an option to order a related product and a second option 655-bmay include an option to schedule a service appointment.

In some cases, the control panel 135 may receive website informationfrom one or more devices associated with an individual of the smart room255. The website information may include identification information ofE-commerce websites visited by the individual and purchases made by theindividual. The control panel 135 in communication with a third-partyserver (e.g., the server 155, an E-commerce server) may provideinformation that may support identifying a product related to pestremoval. For example, the control panel 135 may submit a query that mayinclude one or more search terms and criteria for the third-party serverto use and limit a product search to a specific pest and a productprice. The control panel 135 may receive a list of products related tothe provided search term(s) and criteria, and provide the list ofproducts to the smartphone 605 for viewing by the individual.

The control panel 135 may receive a selection of a product from theindividual via the smartphone 605. After the control panel 135 receivesthe selection of the product, the control panel 135 may proceed togenerate delivery and payment information and provide the information toa server associated with an E-commerce website related to the selectedproduct. In some cases, prior to transmitting and submitting thedelivery and payment information to the E-commerce website, the controlpanel 135 may provide an approval/authorization message to theindividual via the smartphone 605. Once the control panel 135 receivesapproval from the individual, the control panel 135 may process theorder by transmitting the order to the server of the E-commerce website.The control panel 135 may monitor a status of a shipping of the product,by receiving shipping information from the server of the E-commercewebsite. The status of the shipping may be provided by the control panel135 to the smartphone 605 for viewing by the individual.

In some cases, the control panel 135 may receive audio data from thesmartphone 605 in response to the notification message. For example, theindividual wanting to order a product or learn information about a pastproduct order may provide an input (e.g., audio data) at the smartphone605 that may be transmitted to the control panel 135. In some examples,an individual wanting to order a product (e.g., pest related product)may initiate an order by selecting a product from the provided listusing the smartphone 605 via manually selecting the product or via voicecommand. In some cases, the control panel 135 may transmit the order toanother device (e.g., the server 155) to perform one or more functions(including order finalizing, processing, shipping, etc.).

In some cases, an individual may have need of frequently ordering aspecific product (e.g., a pest control product), a sensor unit 510 couldbe placed in an area where the product is frequently used (e.g., near akitchen, near a bathroom, near a bedroom). When the sensor unit 510detects that the product needs to be replaced or reordered (eitherbefore or after the product is entirely gone) the sensor unit 510 maytransmit an order request to the control panel 135 to be processed(e.g., finalizing, processing, shipping). In some cases, the controlpanel 135 may process an order without additional input, from theindividual. The control panel 135 may also select a default providingentity (e.g., consumer store), brand (name-brand vs. store brand),quantity (based on one or more past orders and/or a user selection),shipping information (e.g., cost, shipping entity, time to shipping,time to delivery, delivery requirements such as signature, packaging,some combination, other information, etc.), some combination, or otherinformation. Such defaults may be user related, system related, productrelated, or providing entity related, among other things.

In some cases, the control panel 135 may identify a list of termite andpest control services and transmit a message to the smartphone 605 forthe individual to select a termite and pest control service to servicethe smart room 255. To identify a termite and pest control service, thecontrol panel 135 may communicate with one or more third-party servers(e.g., the server 155, or a search engine server). The control panel 135may communicate one or more search parameters to the third-party server.For example, the control panel 135 may provide a geolocation of a smarthome, a search radius associated with the geolocation, a servicecategory (i.e., termite and pest control service), among others. In somecases, the third-party server may provide a list of identified termiteand pest control service based on the provided search parameters. Thecontrol panel 135 may provide the list to the smartphone 605 for viewingby the individual. The control panel 135 may receive a selection of atermite and pest control service from the individual via the smartphone605.

Once the control panel 135 receives a selection of a termite and pestcontrol service or in the case the control panel 135 has a learnedpreference or a pre-stored setting of a previously used termite and pestcontrol service, the control panel 135 may generate a message andtransmit it to the termite and pest control service. In some examples,the message may include a request to schedule a personnel to visit thesmart room 255 to provide a termite and pest control service during anassigned date. The schedule may be based on a schedule of the individualassociated with the smart room 255. The control panel 135 maysynchronize with a schedule of the individual by downloading theindividual's schedule from the smartphone 605.

In some cases, the control panel 135 may refrain from transmitting themessage until receiving authorization from the individual. In somecases, scheduling the termite and pest control service may includeproviding payment information. The control panel 135 may be configuredwith one or more payments options. For example, an individual may storecredit card information with the control panel 135. As such,transmitting the message to the individual for authorization may includerequesting the individual to authorize payment and scheduling of thetermite and pest control service. The control panel 135 may also providethe payment information in the message transmitted to the termite andpest control service.

The control panel 135 may receive a response message from the termiteand pest control service confirming the request. In some cases, thecontrol panel 135 may transmit a notification message to the smartphone605 notifying the individual of the scheduled termite and pest controlservice. In some cases, the control panel 135 may track a pending statusof the scheduled termite and pest control service, and provide one ormore notifications to the individual when the status is determined to becompleted. In some examples, the control panel 135 may automaticallyschedule the termite and pest control service based on a predeterminedsetting (e.g., preapproval by the individual).

FIG. 7 illustrates an example diagram relating to an example securityand automation environment 700 that supports smart sensing techniques inaccordance with aspects of the present disclosure. In some examples, thesecurity and automation environment 700 may implement aspects of thesecurity and automation environment 500. The security and automationenvironment 700 may include one or more sensor units 510 as describedwith reference to FIG. 5.

The security and automation environment 700 may provide admission toperson 750 to access the smart room 255. In some examples, security andautomation environment 700 may include a doorbell camera. The doorbellcamera may be installed, mounted, or integrated near or at access pointof the smart room 255. In some examples, one or more sensor units 510 inconjunction with the doorbell camera may detect that the person 750 islocated proximate to the access points 515 of the smart room 255 basedon received sensor data. The sensor data may include sensed motion at ornear the access points 515 to the smart room 255, or sensed sound at ornear the access points 515 to the smart room 255.

In some cases, the person 750 may knock or ring a doorbell of entryaccess point to smart room 255. The doorbell camera in communicationwith the control panel 135 may identify a suggested security action. Thesuggested security action may include establishing a communicationsession between a remote device (e.g., the smartphone 605) and acommunication device associated with the doorbell camera at or near theentry of the smart room 255. Additionally or alternatively, thesuggested action may include transmitting instructions for turning alight on or off at the smart room 255 or locking or unlocking an accesspoint (e.g., entry access point) to the smart room 255, or turning analarm on or off to the smart room 255.

In some cases, the control panel 135 may use schedule informationregarding a service personnel scheduled to service the smart room 255 todetermine that the person 750 is the service personnel. In some cases,the control panel 135 may receive sensor data (e.g., captured images,video, motion, sound) and perform post-processing on the sensor data.The control panel 135 may identify a timestamp of the sensor data. Thecontrol panel 135 may compare the timestamp to a scheduled service time.The control panel 135 may validate that the timestamp is within athreshold limit of the scheduled service time. In some examples, thecontrol panel 135 may perform image recognition on a captured image ofthe person 750. If a face is detected, processing the captured imagesmay include determining an identity of the person 750. For instance, ifthe person 750 is there to perform the termite and pest control service,an insignia, symbol, or the like on the person's 750 clothing may bedetected to identify the termite and pest control service. In somecases, the control panel 135 may receive a message from a device (e.g.,remote computing device 140) carried by the person 750. The message mayindicate that the person 750 has arrived at the smart room 255 toperform the termite and pest control service. The message may alsoinclude identification information with respect to an identity of theperson 750 and the termite and pest control service.

In some cases, the control panel 135 may transmit a notification to adevice (e.g., smartphone 605) of an individual associated with the smartroom 255 indicating arrival of the person 750 or that the person 750 isadjacent to or in front of at least one of the access points 515 of thesmart room 255. In some cases, the control panel 135 may coordinate andenable a one-way or two-way communication between the individual (e.g.,homeowner) that may be remote from the smart room 255 and the person750. For example, the one-way or two-way communication may becommunicated from a doorbell camera integrated with a communicationdevice to communicate with the person 750.

The control panel 135 may authorize access for the person 750. Forexample, the control panel 135 may disarm a security system and unlockat least one of the access points 515 for the person 750 to enter thesmart room 255. The access may be specific to the smart room 255. Forexample, the security and automation environment 700 may be associatedwith a plurality of zones (e.g., smart rooms such as a kitchen, a livingroom, other bedrooms). Each zone may have a number of sensor units 510that may be capable of detecting presence of a person. The control panel135 may initiate an alarm if the person 750 is detected roaming aroundother zones outside of the smart room 255.

The control panel 135 may also track a duration of the person 750 withinthe smart room 255 and/or an activity level of the person 750 withrespect to the scheduled service. The control panel 135 may generate andtransmit a statement indicating a total duration of the service to thesmartphone 605. In some cases, the control panel 135 may support andprovide an option for an individual associated with the smart room 255to view a captured image or a real-time video feed. In some cases, thecontrol panel 135 may detect when the person 750 departs from the smartroom 255, and notify the individual of the departure. The control panel135 may also rearm the security system (or zone) of the smart room 255based on the departure of the person 750.

FIG. 8 illustrates an example diagram relating to an example securityand automation environment 800 that supports smart sensing techniques inaccordance with aspects of the present disclosure. In some examples, thesecurity and automation environment 800 may implement aspects of thesystem 100. In some examples, the security and automation environment800 may implement aspects of the security and automation environment200-a, 200-b, 400, 500, and 700. The security and automation environment800 may include one or more sensor units 810 and one or more accesspoints 815. For example, the access points 815 may include windows ordoors of a smart room 255. The one or more sensor units 810 may beinstalled, mounted, or integrated with one or more of the access points815, or alternatively with an interior and/or an exterior surface of thesmart room 255.

The control panel 135 may be located within the smart room 255. Thecontrol panel 135 may receive data from the one or more sensor units 810that may be installed and mounted with a surface of the smart room 255.The one or more sensor units 810 may be integrated with a home applianceor fixture such as a light bulb fixture. For example, a first sensorunit may be installed and mounted on a wall, a second sensor unit may beinstalled or mounted on a floor. Additionally or alternatively, a thirdsensor unit may be installed or integrated with a light fixture. In someexamples, the control panel 135 may communicate and receive dataperiodically or continuously from the sensor units 810. The controlpanel 135 and the one or more sensor units 810 may communicate accordingto one or more RATs.

In some cases, the one or more sensor units 810 may monitor acleanliness level of the smart room 255. To monitor the cleanlinesslevel, the control panel 135 may in combination with the one or moresensor units 810 analyze sensor data to determine a change in thecleanliness level. For example, the control panel 135 may apply machinelearning to determine a change in a cleanliness level of the smart room255.

At least one sensor unit 810 may include a camera. The camera maycapture images of the smart room 255 at an initial time. The capturedimages and initial time may be related to a period where the smart room255 is considered to be at a normal cleanliness level. The normalcleanliness level may be assigned or selected by an individual. Forexample, the control panel 135 may display, at the control panel 135 orat a device of the individual, images of the smart room 255. Theindividual may select one or more captured images considered by theindividual to be an indication of a clean room. The control panel 135may receive the selection and assign the selected images as the trainingset for a machine learning technique. At a later time, the control panel135 may receive captured images from the one or more sensor units 810.The control panel 135 may perform machine learning on the receivedcaptured images from the sensor units 810. For example, the controlpanel 135 may compare the received captured images to the training set,and determine a cleanliness level. In some examples, the control panel135 may perform a correlation between the captured images and thetraining set to identify patches (e.g., zone, section, area) that may beindicative of uncleanliness. The control panel 135 may performadditional processing of the captured images to determine anidentification of the patches. For example, the control panel 135 mayperform image processing and recognition to identify that a first patch820-a may include one or more shoes, a second patch 820-b may be a stainon a carpet, and that a third patch 820-c may be a batch of clotheslaying on a couch.

In some cases, the control panel 135 may determine to perform a functionbased on the identified cleanliness level of the smart room 255. Forexample, the control panel 135 may identify one or more recommendedoptions for an individual associated with the smart room 255. In anexample, a recommended option may be one or more cleaning products, anda second option may be to schedule a housekeeping service to visit thesmart room 255.

FIG. 9A illustrates an example of a wireless device 900 that supportssmart sensing techniques in accordance with aspects of the presentdisclosure. The wireless device 900 may be a smartphone 905. Thewireless device 900 may also be a control panel as described in FIGS. 1and 2. The wireless device 900 may also implement aspects of thewireless device 300 or 600. The smartphone 905 may include a userinterface 910. The user interface 910 may be a touch screen that maydisplay one or more graphics, and recognize a touch from an individual,stylus, or the like. The smartphone 905 may receive and display themessage received from the control panel 135 via dialogue window 915 onthe user interface 910. For example, the message may provide anindividual with a pre-generated message stating e.g., “Your home has aproblem. Deal with it.” The message may also provide additionalinformation. To view the additional information, the individual mayselect the “Press for more” option 920 within the dialogue window 915.

FIG. 9B illustrates an example of a wireless device 900 that supportssmart sensing techniques in accordance with aspects of the presentdisclosure. The user interface 910 may change from a home screen anddisplay one or more additional windows (e.g., dialogue windows or modalwindows). In some cases, additional, different or fewer buttons may beprovided, or different types of inputs may be provided on the userinterface 910. For example, a tray 950 may display icons of frequentlyused applications. After the individual selects the option 920 to viewadditional information, the user interface 910 may display theadditional information in a dialogue window 930. The additionalinformation may include one or more options for the individual torespond to the notification. For example, a first option 935 may be a“Yes, please” decision, a second option 940 may be a “No, thanks”selection, and a third option 945 may be a “Cancel” choice, as describedwith reference to FIGS. 3B and 6B.

FIG. 9C illustrates an example of a wireless device 900 that supportssmart sensing techniques in accordance with aspects of the presentdisclosure. In some cases, the control panel 135 may determine a set ofrecommended options based on a learned preference or a pre-storedsetting of the individual. For example, the control panel 135 mayanalyze historical data related to actions taken by the individual withrespect to the detection of uncleanliness in the smart room 255. Thedialogue window 915 may display one or more selectable options for theindividual. A first option 955-a may include an option to order arelated product and a second option 955-b may include an option toschedule a service appointment.

In some cases, the control panel 135 may receive information from one ormore devices associated with an individual of a smart home. Theinformation may include identification information of websites visitedby the individual and purchases made by the individual. The controlpanel 135 in communication with a third-party server (e.g., the server155, an E-commerce server) may provide information that may supportidentifying a product related to a cleaning product. For example, thecontrol panel 135 may submit a query that may include search terms andcriteria for the third-party server to use and limit a product search toa specific cleaning product brand and/or price. The control panel 135may receive a list of products related to the provided search term(s)and criteria, and provide the list of products to the smartphone 905 forviewing by the individual.

In some cases, an individual may frequently order a specific product(e.g., a laundry detergent, clothing, toiletries, cleaning products,etc.), at least one sensor unit 810 could be placed in an area of thesmart room 255 where the product is frequently used (e.g., near akitchen, near a bathroom, near a bedroom). When the at least one sensorunit 810 detects that the product needs to be replaced or reordered(before the product is entirely gone) the at least one sensor unit 810may transmit an order request to the control panel 135 to be processed(e.g., finalizing, processing, shipping). In some cases, the controlpanel 135 may process an order without additional input, from anindividual. The control panel 135 may also select a default providingentity (e.g., consumer store), brand (name-brand vs. store brand),quantity, shipping information (e.g., cost, shipping entity, time toshipping, time to delivery, delivery requirements such as signature,packaging, some combination, other information, etc.), or otherinformation.

In some cases, the control panel 135 may also suggest other products forordering, e.g., products that may need to be replaced or reordered(either before or after the product is entirely gone) such astoiletries, cosmetics, shaving products, etc. For example, an individualmay select and designate to always order a product from one retailer butorder a different product (e.g., paper towels from another retailer). Asanother example, an individual may request to always order one categoryof items (e.g., food items) from one retailer but another category ofitems (e.g., clothing, toiletries) from another retailer. In some cases,the control panel 135 may receive user related information that may bebased on a series of questions based on different options (providingspecific retailers to choose from, most important factors such as price,shipping speed, quality, etc.), past order history (relating to thesame, related, and/or different products), etc.

The control panel 135 may receive a selection of a product from theindividual via the smartphone 905. After the control panel 135 receivesthe selection of the product, the control panel 135 may proceed togenerate delivery and payment information and provide the information toa server related to the selected product. In some cases, prior totransmitting and submitting the delivery and payment information toserver or website (e.g., E-commerce platform), the control panel 135 mayrequest an approval from the individual via the smartphone 905. Once thecontrol panel 135 receives approval from the individual, the controlpanel 135 may process the order by transmitting the order to the server.The control panel 135 may monitor a status of a shipping of the product,by receiving shipping information from the server. The status of theshipping may be provided by the control panel 135 to the smartphone 905for viewing by the individual.

In some cases, the control panel 135 may identify a list of housekeepingservices and transmit a message to the smartphone 905 for the individualto select a housekeeping service to service the smart room 255. Toidentify a housekeeping service, the control panel 135 may communicatewith one or more third-party servers (e.g., the server 155, or a searchengine server). The control panel 135 may communicate one or more searchparameters to the third-party server. For example, the control panel 135may provide a geolocation of a smart home, a search radius associatedwith the geolocation, a service category (i.e., housekeeping service),among others. In some cases, the third-party server may provide a listof identified housekeeping service based on the provided searchparameters. The control panel 135 may provide the list to the smartphone905 for viewing by the individual. The control panel 135 may receive aselection of a housekeeping service from the individual via thesmartphone 905. The control panel 135 may proceed to schedule anappointment with the selected housekeeping service.

In some cases, the control panel 135 may also communicate with anappliance. An appliance may include a microwave oven, an HVAC, a washingmachine, a dryer, a gas fireplace, a refrigerator, a vacuum cleaner, anelectric water heater tank. These appliances may also be smartappliances that may communicate with the control panel 135 or a device(e.g., the local computing devices 115, 120 or the remote computingdevice 140) associated with an individual (e.g., a smartphone, laptop,TV).

In some examples, the control panel 135 may communicate with a washerand a dryer to receive laundry-related information. For example, awasher and dryer may transmit laundry-related information to the controlpanel 135. The control panel 135 may identify a timing informationindicating when the individual associated with the smart room 255 didlaundry last. The control panel 135 may use this information in additionto the identified mound of clothes laying on the couch to suggest to theindividual to perform laundry. In some cases, the control panel 135 mayrecommend as part of the housekeeping service to request a laundryservice.

In some examples, an individual may be unable of performing a laundryservice because the washer or the dryer may require maintenance. In somecases, the control panel 135 may receive a message, from the individualassociated with the smart room 255, indicating that the washer or thedryer requires attention. Alternatively, the control panel 135 may alsoreceive diagnostic information directly from the washer and the dryer.The diagnostic information may include a make and model of the washerand the dryer, warranty coverage information, repair and supportinformation, vendor information, an energy consumption and cost reportof operating the dryer and the washer or any combination thereof. Thedryer and the washer may also provide the diagnostic informationdirectly to the device associated with the individual. In some cases,the control panel 135, the local computing devices 115, 120, or theremote computing device 140 may establish a connection with the dryerand the washer. Based on the connection, the control panel 135, thelocal computing devices 115, 120, or the remote computing device 140 mayreceive the diagnostic information directly from the washer and thedryer.

The control panel 135 may determine to schedule a maintenance servicebased on the received diagnostic information. For example, the controlpanel 135 may use the repair and support information, or the vendorinformation to schedule a maintenance service or submit an order forreplacing the dryer or the washer based on the warranty coverageinformation. In some cases, the control panel 135 as part of schedulingthe maintenance service, may identify a vendor and provide the warrantycoverage information to the vendor. The control panel 135 may prior tocontacting the vendor associated with the dryer and the washer,communicate the diagnostic information to the individual. For example,the control panel 135 may provide the diagnostic information for viewingon a device (e.g., smartphone, laptop, TV) associated with theindividual.

In some cases, the control panel 135 may receive sensor data associatedwith an HVAC system. For example, the control panel 135 may receivesensor data indicating an HVAC filter status associated with at leastone of the HVAC registers 825. The HVAC filter status may indicate thatan HVAC filter may require replacement. The HVAC filter may be adisposable air filter that may be conventionally employed with at leastone of the HVAC registers 825. In some cases, however, after a period ofuse, an HVAC filter may become dirty or blocked and may need to bereplaced. By employing the control panel 135 to monitor and manageproper filter maintenance, an HVAC system associated with the securityand automation environment 800 may continue to operate at maximumefficiency and reduce operating costs.

In some cases, at least one sensor unit 810 may be an airflow sensorthat may be installed on a surface of at least one of the HVAC registers825. The air flow sensor may monitor a level of airflow dispensing fromat least one of the HVAC registers 825 when the HVAC system is operating(i.e., turned ON). The control panel 135 may receive sensor data fromthe airflow sensor. In some cases, the control panel 135 may determinethat an HVAC filter may require replacement based on the received sensordata. For example, the sensor data may indicate an airflow level thatmay be below a threshold value.

In some examples, the control panel 135 may predict a future conditionof an HVAC filter or one or more other components of the HVAC system.For example, the control panel 135 may predict a lifespan of an HVACfilter associated with at least one of the HVAC registers 825 based onone or more parameters (e.g., usage model of the HVAC system). The oneor more parameters may include a current airflow level associated withan HVAC register, an average runtime value of the HVAC system, and afrequency of operation (e.g., a number of times a day, week, or a month)associated with the HVAC system, or a power signature of the HVACsystem, or any combination thereof. The control panel 135 may applymachine learning techniques to predict the future condition of the HVACfilter using current sensor data, a training set of sensor data, andhistorical sensor data associated with a HVAC filter and at least one ofthe HVAC registers 825, and the one or more parameters.

In some cases, the control panel 135 may receive sensor data related toa plumbing system. For example, the control panel 135 may receive sensordata from a sensor unit indicating a status associated with a plumbingfixture. The status may indicate a reduced water flow or water pressureassociated with the plumbing fixture. The status may also indicate thatthe plumbing fixture may require maintenance e.g., based on the reducedflow or pressure. A plumbing fixture may include a bathtub, a channeldrain, a kitchen sink, a shower, a faucet, a water closet, among others.

In some cases, a sensor unit may be a water flow sensor, a pressuresensor, a pipe temperature sensor, an acoustic sensor, an ultrasonicflowmeter sensor that may installed, mounted, or integrated with asurface of a plumbing fixture or a component of the plumbing fixture(e.g., a valve, a pipe). For example, a water flow sensor may beintegrated with a valve to monitor a flow of water. The control panel135 may receive sensor data from the water flow sensor. In some cases,the control panel 135 may determine that a plumbing fixture or acomponent of it may require replacement based on the received sensordata. For example, the sensor data may indicate a water flow level thatmay be below a threshold value.

In some examples, a sensor unit may be a water softener sensor. Thewater softener sensor may monitor a calcium and magnesium level and/orwater flow level of a plumbing component (e.g., faucet, valve, spout).The water softener sensor may record, track, and provide information tothe control panel 135 relating to the calcium and magnesium level and/orthe water flow level of the plumbing component. The water softenersensor may determine when the plumbing component has increased calciumand magnesium levels and/or reduced water flow, or detect a leak orother problem. Alternatively, the water softener sensor may determinethat the plumbing component may need to be replaced or replenished. Forexample, the water softener sensor may determine that the plumbingcomponent needs to be serviced (e.g., replenished by applying watersoftening chemicals) based on the increased calcium and magnesium levelsand/or reduced water flow. Alternatively, in some cases, the watersoftener sensor may determine that the plumbing component may need to bereplaced.

The control panel 135 may receive the information from the watersoftener sensor. In this example, the control panel 135 may determinethe plumbing component may need to be replaced based on the receivedinformation. In some examples, the information may include a uniqueidentifier associated with the water softener sensor that may correlatethe water softener sensor with a particular plumbing component in asmart home. The control panel 135 may parse and retrieve additionalinformation (e.g., plumbing component specification) associated with theplumbing component from a database (e.g., local memory or remotememory); or in some cases from the Internet. Upon determining that theplumbing component requires a replacement, the control panel 135 maygenerate and transmit a message to an appropriate individual (e.g., homeowner) or a third-party enterprise. In some examples, the message mayinclude a description indicating that the plumbing component may need tobe replaced. In some cases, the message may also include orderinginformation, vendor information, address information, etc.

In some examples, the control panel 135 may predict a future conditionof a plumbing fixture or a component of it. For example, the controlpanel 135 may predict a lifespan of a shower nozzle associated with ashower based on one or more parameters (e.g., usage model of the showernozzle). The one or more parameters may include a current water flowlevel associated with the shower nozzle, an average runtime value of theshower, and a frequency of operation (e.g., a number of times a day,week, or a month) associated with the shower, or a water signature ofthe shower, or any combination thereof. The control panel 135 may applymachine learning techniques to predict the future condition of theshower nozzle using current sensor data, a training set of sensor data,and historical sensor data associated with the shower nozzle and the oneor more of the parameters.

In some cases, the control panel 135 may provide a suggested product(e.g., water softening product, an HVAC filter) for ordering. Thecontrol panel 135 in communication with a third-party server (e.g., theserver 155) may provide information that may support identifying aproduct related to HVAC systems or plumbing systems. For example, thecontrol panel 135 may submit a query that may include search terms forthe third-party server to use and limit a product search to a specificwater softening or HVAC product brand and/or price. The control panel135 may receive a list of products related to the provided searchterm(s) and criteria, and provide the list of products to the smartphone905 for viewing by the individual.

The control panel 135 may also communicate and perform one or morefunctions with the third-party enterprise. In this case, the third-partyenterprise may be a vendor or a plumbing service, or an HVAC service. Assuch, the control panel 135 may provide ordering information to thevendor or the plumbing service, or an HVAC service. That is, the controlpanel 135 may automatically order a new plumbing component to bedelivered to the smart home using the ordering information.Alternatively, the control panel 135 may delay communication, untilreceiving feedback from the individual, with the third-party enterprise.In some cases, the control panel 135 may track a pending status of thereplacement of the plumbing component, and provide notification, whenthe status is determined to be completed. In some examples, the controlpanel 135 may add the plumbing component or a resource (e.g., watersoftening chemicals) associated with the plumbing component on ashopping list via an application running on a device of the individual.As such, the individual may be reminded to purchase water softeningchemicals at a later time; for example when visiting a business (e.g., ahome goods store).

In some cases, the control panel 135 may receive a selection of aproduct from the individual via the smartphone 905. After the controlpanel 135 receives the selection of the product, the control panel 135may proceed to generate delivery and payment information and provide theinformation to the third-party server related to the selected product.In some cases, prior to transmitting and submitting the delivery andpayment information to the third-party server, the control panel 135 mayprovide an approval/authorization message to the individual via thesmartphone 905. Once the control panel 135 receives approval from theindividual, the control panel 135 may process the order by transmittingthe order to the third-party server. The control panel 135 may monitor astatus of a shipping of the product, by receiving shipping informationfrom the third-party server. The status of the shipping may be providedby the control panel 135 to the smartphone 905 for viewing by theindividual

In some cases, the control panel 135 may identify a maintenance serviceand transmit a message to the individual to select a maintenance serviceto service an appliance (e.g., the washer and the dryer). To identify amaintenance service, the control panel 135 may communicate with one ormore third-party servers (e.g., the server 155, or a search engineserver). The control panel 135 may communicate one or more searchparameters to the third-party server. In some cases, the third-partyserver may provide a list of identified maintenance services based onthe provided search parameters. The control panel 135 may provide thelist to the individual. The identified maintenance services may beassociated with a vendor or a contractor. For example, in some cases,the control panel 135 may communicate to a third-party server a querywith a list of variables to identify one or more contractors that mayperform the maintenance service. For instance, an individual may desireto have an appliance serviced at a lower price compared to a price thata supplier of the appliance may charge. The list of variables mayinclude diagnostic information associated with the appliance of therequested maintenance, timing of the requested maintenance, a locationof the requested maintenance, a difficulty level of the requestedmaintenance, among others. The control panel 135 may receive from thethird-party server (e.g., the server 155) a list of contractorsincluding contractor information (e.g., review, biography, credentials)and price quotes of each contractor. Although, the above description iswith regards to a maintenance service, the same may apply foridentifying a housekeep service.

The control panel 135 may receive a selection of a maintenance servicefrom the individual via the device of the individual or directly via thecontrol panel 135. Once the control panel 135 receives a selection ofthe maintenance service or in the case the control panel 135 has alearned preference or a pre-stored setting identifying a maintenanceservice, the control panel 135 may generate a message and transmit it tothe maintenance service. In some examples, the message may include arequest to schedule a personnel to visit the smart room 255 to provide amaintenance service during a specified data and time. The schedule maybe based on a schedule of the individual associated with the smart room255.

In some cases, the control panel 135 may refrain from transmitting themessage until receiving authorization from the individual. In somecases, scheduling the maintenance service may include providing paymentinformation. The control panel 135 may be configured with one or morepayments options. As such, transmitting the message to the individualfor authorization may include requesting the individual to authorizepayment and scheduling of the maintenance service. The control panel 135may also provide the payment information in the message transmitted tothe maintenance service.

The control panel 135 may receive a reply message from the maintenanceservice confirming the request. In some cases, the control panel 135 maytransmit a notification notifying the individual of the scheduledmaintenance service. In some cases, the control panel 135 may track apending status of the scheduled maintenance service and providenotification to the individual when the status is determined to becompleted.

The control panel 135 may also monitor a status of a network accesspoint 805. Monitoring the status may include receiving operatingcharacteristics and power consumption from the network access point 805.In some examples, an operating characteristic may include a signalstrength indicator for wireless communication, a failure indicator, amaintenance indicator, among others. In some cases, the control panel135 may receive diagnostic information including the operatingcharacteristic from the network access point 805. The control panel 135may use the diagnostic information to perform a function. For example,the control panel 135 may determine to transmit a diagnostic report to aservice provider (e.g., a network operator) associated with the networkaccess point 805. In some cases, the control panel 135 may transmit amessage including the diagnostic report to a device associated with anindividual of the smart room 255.

In some cases, the network access point 805 may be associated with anetwork sensor that may include an Internet sensor or a home Wi-Fisensor. The Internet sensor may determine a connection status to theInternet. The home Wi-Fi sensor may determine a quality of service (QoS)of a Wi-Fi network. In some cases, the network sensor may be acombination of the Internet sensor and the home Wi-Fi sensor. As such,the network sensor may determine a QoS based on a connection to theInternet via the Wi-Fi network. The network sensor may record, track,and provide information associated with sensor data of the networksensor to the control panel 135.

The control panel 135 may use the information provided from the networksensor to modify, update, or replace a network component associated withthe network sensor. For example, the network component may be a homerouter. In this case, the control panel 135 may determine that a networkconnection (e.g., Wi-Fi network) is below a QoS threshold value based onthe provided information. As such, the control panel 135 may notify anindividual (e.g., home owner) or a third-party enterprise (e.g., networkoperator) of the QoS threshold value not being satisfied. The controlpanel 135 may schedule an internet-provider service based on thediagnostic information. For example, the control panel 135 may use oneor more techniques described herein to schedule the internet-providerservice.

FIG. 10 illustrates an example diagram relating to an example securityand automation environment 1000 that supports smart sensing techniquesin accordance with aspects of the present disclosure. In some examples,the security and automation environment 1000 may implement aspects ofthe security and automation environment 800. The security and automationenvironment 1000 may include one or more sensor units 810 as describedwith reference to FIG. 8. The security and automation environment 1000may provide admission to person 1050 to access the smart room 255. Insome examples, security and automation environment 1000 may include adoorbell camera. The doorbell camera may be installed, mounted, orintegrated near or at access point of the smart room 255. In someexamples, one or more sensor units 810 in conjunction with the doorbellcamera may detect that the person 1050 is located within a distancethreshold to an entry access point of the smart room 255 based onreceived sensor data. The sensor data may include sensed motion at ornear the entry to the smart room 255, sensed sound at or near the entryto the smart room 255, sensed activation of a doorbell at or near theentry to the smart room 255.

In some cases, the person 1050 may knock or ring a doorbell of entryaccess point to smart room 255. The doorbell camera in communicationwith the control panel 135 may identify a suggested security action. Thesuggested security action may include establishing a communicationsession between a remote device (e.g., the smartphone 905) and acommunication device associated with the doorbell camera at or near theentry of the smart room 255. Additionally or alternatively, thesuggested action may include transmitting instructions for turning alight on or off at the smart room 255 or locking or unlocking an accesspoint (e.g., entry access point) to the smart room 255, or turning analarm on or off to the smart room 255.

In some cases, the control panel 135 may use schedule informationregarding a service personnel scheduled to service the smart room 255may determine that the person 1050 is a housekeeper personnel. In somecases, the control panel 135 may receive sensor data (e.g., capturedimages, video, motion, sound) and perform post-processing on the sensordata. The control panel 135 may identify a timestamp (e.g., time anddate) associated with the sensor data indicating the detection of theperson 1050. The control panel 135 may compare the timestamp to ascheduled service time. The control panel 135 may validate that thetimestamp is within a threshold limit of the scheduled service time.

In some examples, the control panel 135 may perform image recognition(e.g., facial recognition) on a captured image of the person 1050. If aface is detected, processing the captured images may include determiningan identity of the person 1050. For instance, if the person 1050 isthere to perform the housekeeping service, an insignia, symbol, or thelike on the person's 1050 clothing may be detected to identify thehousekeeping service. In some cases, the control panel 135 may receive amessage from a device carried by the person 1050. The message mayindicate that the person has arrived at the smart room 255 to performthe housekeeping service.

In some cases, the control panel 135 may transmit a notification to adevice of an individual associated with the smart room 255 indicatingarrival of the person 1050 or that the person 1050 is at an entry of thesmart room 255. In some cases, the control panel 135 may coordinate andenable a one-way or two-way communication between the individual (e.g.,homeowner) that may be remote from the smart room 255 and the person1050. For example, the one-way or two-way communication may becommunicated from a doorbell camera integrated with a communicationdevice to communicate with the person 1050.

The control panel 135 may authorize access for the person 1050. Forexample, the control panel 135 may disarm a security system and unlockan access point for the person 1050 to enter the smart room 255. Theaccess may be specific to the smart room 255. For example, the securityand automation environment 1000 may be associated with a plurality ofzones (e.g., smart rooms such as a kitchen, a living room, otherbedrooms). Each zone may have a number of sensor units 810 that maydetect presence of a person. The control panel 135 may initiate an alarmif the person 1050 is detected roaming around other zones outside of thesmart room 255. The control panel 135 may also track a duration of theperson 1050 being present within the smart room 255 and/or an activitylevel of the person 1050 with respect to the scheduled service. Thecontrol panel 135 may generate a report indicating a total duration ofthe service and transmit the report to the smartphone 905. In somecases, the control panel 135 may detect when the person 1050 departsfrom the smart room 255, and notify the individual of the departure. Thecontrol panel 135 may also rearm the security system (or zone) of thesmart room 255 based on the departure of the person 750.

FIG. 11 illustrates an example diagram relating to an example securityand automation environment 1100 that supports smart sensing techniquesin accordance with aspects of the present disclosure. The security andautomation environment 1100 may include an appliance 1105. The appliance1105 may be a smart appliance. For example, appliance 1105 may be asmart refrigerator. The appliance 1105 may be integrated with a receiverfor receiving information such as packets, user data, or controlinformation associated with various information channels (e.g., controlchannels, data channels, and information related to smart sensingtechniques, etc.), and a transmitter for transmitting informationassociated with consumables stored within the appliance 1105. Forexample, the appliance 1105 may communicate with the control panel 135or the local computing device 120. The appliance 1105 may have one ormore sensor units 1110 installed, mounted, or integrated within theappliance 1105.

At least one of the sensor units 1110 may be a sensor that may monitor aconsumable item 1115. In some cases, monitoring the consumable item 1115may include identifying the consumable item. The at least one of thesensor units 1110 may be a camera. The camera may capture an image ofthe consumable item e.g., 1115-a and 1115-b. The camera may transmit thecaptured image of the consumable item to the control panel 135. Thecontrol panel 135 may receive the captured image and perform imageprocessing to identify that the consumable item 1115-a is e.g., awatermelon, and that the consumable item 1115-b is a milk carton. Thecontrol panel 135-a may also determine an amount of the consumable item1115-a and 1115-b.

In some cases, the control panel 135 may apply machine learningtechniques to predict a future condition of a consumable item (e.g.,when the a consumable item will be completely consumed). In some cases,the machine learning technique may include identifying a consumptionrate of the consumable item based on a consumption model of theconsumable item. The control panel 135 may automatically request apurchase order with a third-party enterprise to restock and deliver theconsumable item.

The control panel 135 may use the prediction and additional information(e.g., a consumption rate, occurrences of the consumable item beingreplenished by an individual of the smart home) perform a function. Thefunction may include providing an order request to a service (e.g.,E-commerce platform) for the consumable item 1115 to be replenished anddelivered. The control panel may alternatively seek permission from anindividual prior to providing the order request. In some examples, thecontrol panel 135 may seek the permission based on order parameters suchas price of an item, quantity of the item, shipping cost associated withthe item, etc. The control panel 135 may transmit a notification to theindividual's personal device (e.g., smartphone) or adding the consumableitem to a shopping list via an application programmed and running on thepersonal device.

In some cases, the control panel 135 may generate a message indicatingthe one or more consumables items 1115 to an individual. For example,the control panel 135 may notify a third-party enterprise or theindividual via the local computing device 120. In this case, thethird-party enterprise may be a vendor such as a grocery store. Thevendor may schedule with the control panel 135 to deliver or havedelivered the consumables items 1115. The control panel 135 may provideand support a secure delivery of a consumable item to a smart home. Insome cases, the control panel 135 may indicate in a message, transmittedto the vendor, a location of the smart home to deliver the requiredconsumables items. Similar applications may apply to household itemssuch as cosmetics, laundry detergent, pet supplies, paper products,prescription medication, and other homecare supplies

FIG. 12 illustrates an example diagram relating to an example securityand automation environment 1200 that supports smart sensing techniquesin accordance with aspects of the present disclosure. The security andautomation environment 1200 may include one or more sensor units 1210and an access point 1220. Security and automation environment 1200 may,additionally or alternatively, support delivery of packages, consumableitems, products, and services, to the smart home 250. Access point 1220may include an entrance door to the smart home 250. Additionally, accesspoints of security and automation environment 1200 may include one ormore garage doors of the smart home 250. In some cases, the one or moresensor units 1210 may be installed, mounted, or integrated with theaccess point 1220, or alternatively with an interior or exterior surfaceof the smart home 250.

In some cases, the control panel 135 may or an individual associatedwith the smart home 250 may select to generate a custom access code fora delivery personnel. The custom access code may include a random accesscode, a preconfigured access code, and a delayed access code, or anycombination thereof. The control panel 135 or he individual may alsoselect a delivery area at the smart home 250 where a package (e.g.,product-related) is to be delivered. For example, the control panel 135or the individual may choose a garage as the designated location at thesmart home 250. Accordingly, the provided access code may enable adelivery person to access the garage of the smart home 250.

In some cases, the control panel 135 or the individual may choose justinside a front door at the smart home 250. Accordingly, the providedaccess code may enable a delivery person to access inside the front doorof the smart home 250. Additionally or alternatively, the control panel135 or the individual may select a delivery time for a package duringordering of a product. For example, a delivery time may be a window oftime such as a two hour window between 1:00 PM and 3:00 PM on Saturday,Nov. 11, 2017.

In some examples, smart home 250 may include a doorbell camera 1230. Thedoorbell camera 1230 may be installed, mounted, or integrated near or ataccess point 1220. The doorbell camera 1230 may receive informationregarding a delivery of a package to the smart home 250. The informationreceived may include a delivery company name, delivery personinformation (e.g., delivery person name, photo ID, work ID, etc.), aunique code (e.g., barcode, QR code, etc.), a unique code associatedwith the delivery person, scheduled date of delivery, an expected timeof delivery (e.g., a window of time), tracking number, number ofpackages, weight of each package, dimensions of each package, etc.

In some cases, doorbell camera 1230 may be granted access to a personalaccount associated with a delivery company. Thus, in some cases, thedoorbell camera 1230 in communication with control panel 135 may querydelivery information by accessing the personal account, from whichcontrol panel 135 or the doorbell camera 1230 may receive notificationsof expected deliveries, real-time updates to the delivery information,real-time notices of a delivery person's arrival to the smart home 250,or a combination thereof. In some cases, the doorbell camera 1230 maygenerate a notification based on the received information regarding adelivery of a package to the smart home 250.

The doorbell camera 1230 may also provide instructions to a deliveryperson based on a preconfigured setting. For example, an individualassociated with the smart home 250 may provide authorization to deliverypersonnel to drop off packages within a particular zone (e.g., packagedelivery zone 1235, or designated area in a garage of the smart home250). The package delivery zone 1235 may be outside or inside the smarthome 250. In some cases, the doorbell camera 1230 in communication withone or more sensor units 1210 may detect a delivery person 1250. In somecases, the doorbell camera 1230 in communication with one or more sensorunits 1210 may determine a location of a delivery vehicle 1255.

The location of the delivery vehicle 1255 may be determined by alocation device on the delivery vehicle 1255 such as a GPS. Additionallyor alternatively, the delivery person 1250 may provide informationregarding his or her location (e.g., present delivery location, nextdelivery location). In some examples, based on geo-location, a state ofa lock component associated with the access point 1220 may change whenthe delivery person 1250 is within a particular range.

In some examples, the doorbell camera 1230 in conjunction with controlpanel 135 may receive information indicating that the delivery vehicle1255 is at and/or within a predefined distance of the smart home 250.The doorbell camera 1230 may receive sensor data from one or more sensorunits 1210 located outside of the smart home 250 that may be configuredto recognize the delivery vehicle 1255, a delivery uniform, a deliverycompany logo, etc. Thus, in some cases, upon receiving informationindicating the delivery vehicle 1255 is at or near the smart home 250,the doorbell camera 1230 may scan captured images to detect the deliveryvehicle 1255 and/or the delivery person 1250.

The delivery person 1250 may receive instructions at a wireless devicevia the control panel 135 or the doorbell camera 1230 to drop of apackage in package delivery zone 1235. In this example, the packagedelivery zone 1235 may be an area near the entrance—i.e., access point1220. In some cases, package delivery zone 1235 may include a securedstorage component with a digital or mechanical lock for delivery person1250 to drop off the package within the secured storage component. Insome cases, the delivery person 1250 may be provided a security code forunlocking the secured storage component via the doorbell camera 1230based at a time that the delivery person 1250 is detected and identifiedby the doorbell camera 1230. One or more sensor units 1210 may detectthe delivery person 1250 near or at access point 1220. The one or moresensor units 1210 may capture sensor data such as, but not limited to,an image, record a video, capture audio data, monitor motion, etc.,associated with the delivery person 1250. The doorbell camera 1230 maydetermine an identity of the delivery person 1250.

In some examples, the doorbell camera 1230 may identify a presence of apackage carried by the delivery person 1250 based on performing ananalysis of captured image, video, or both associated with the deliveryperson 1250. The doorbell camera 1230 may broadcast instructions to thedelivery person 1250 to deliver the package to a designated location(i.e., 1235) at or near the entry to the smart home 250. Theinstructions may be pre-recorded, custom text, or both. Custom text mayinclude pre-packaged text that is broadcasted (e.g., played) via thedoorbell camera 1230. Pre-packaged text may be associated with one ormore individuals of the smart home 250 pre-recording response messages.In some examples, the doorbell camera 1230 may broadcast a messagenotifying the delivery person 1250 that he or she is being recordedbased on identifying the presence of the package carried by the deliveryperson 1250.

In some cases, the delivery person 1250 may ring a doorbell and/or knockon the door (e.g., access point 1220) of the smart home 250 and/ortrigger a motion detector. Upon detecting the delivery person 1250 atthe door, the doorbell camera 1230 may capture a photo and/or videoimage of the delivery person 1250. The doorbell camera 1230 may comparethe captured image to an image of the delivery person 1250 provided by adelivery company (e.g., a photo ID of the delivery person). In somecases, an automated system (e.g., a prerecorded message, a voicesimulated message, etc.) of the doorbell camera 1230 may request thatthe delivery person 1250 stare into a camera in order to capture animage with a similar viewpoint as that of an image of the deliveryperson 1250 provided by the delivery company.

Additionally, or alternatively, the delivery person 1250 may beinstructed to place an identification card in relation to a camera ofthe doorbell camera 1230. The identification card may include a photo IDof the delivery person 1250, a name of the delivery person 1250, acompany name, a company logo, a unique code (e.g., barcode, QR code,etc.), short-range communication capabilities (e.g., radio frequency ID(RFID), near-field communication (NFC), etc.), and the like. Uponreceiving data from and/or capturing an image of the identificationcard, the doorbell camera 1230 may use any combination of the capturedinformation (e.g., photo ID, name, barcode, RFID, etc.) to verify theidentity of the delivery person 1250. In some cases, such as when thedelivery person 1250 arrives outside an expected period of time,additional verification may be requested.

In some examples, before granting the delivery person 1250 access to adelivery area (i.e., package delivery zone 1235), the doorbell camera1230 may request the delivery company verify the location of thedelivery person 1250, via communication with the control panel 135. Forexample, control panel 135 may query a server of the delivery company todetermine the current location of the delivery vehicle 1255 associatedwith the expected delivery. Additionally, or alternatively, beforegranting the delivery person 1250 access to a delivery area (i.e.,package delivery zone 1235), the control panel 135 may request that aperson associated with the smart home 250 approve granting the deliveryperson 1250 access to the delivery location (i.e., package delivery zone1235). For example, the individual may receive a real-time notificationregarding the arrival of the delivery person 1250 to the smart home 250.

The individual may receive a live audio and/or photo and/or video imagefeed of the delivery in progress. In some cases, the individual may beenabled to communicate with the delivery person 1250 in real-timebetween the individual's mobile device (e.g., local computing device120) and communication component in communication with the doorbellcamera 1230, via a network. In some examples, the doorbell camera 1230may request that the delivery person 1250 input information associatedwith the package such as a tracking number and/or an employeeidentification code. In some cases, the doorbell camera 1230 maydetermine that the information is sent and/or received by a computingmachine owned by the delivery company. For example, the control panel135 may determine that the information entered by the delivery person1250 is verified and registered by a secure server owned by the deliverycompany. Upon verifying that the information is entered and verified bythe delivery company, temporary access to the package delivery zone 1235may be granted.

In some examples, the control panel 135 may also transmit a temporaryaccess code to a device associated with the delivery person 1250. Forexample, upon detecting the arrival and/or verifying the identity of thedelivery person 1250, the control panel 135 may transmit a temporaryaccess code to a device of the delivery person 1250 (e.g., smart phone,computing device, near-field communication device). The temporary accesscode may include a temporary electronic key configured to unlock anaccess point, a temporary frequency code configured to open an accesspoint wirelessly, or a temporary keypad code configured to open anaccess point via a keypad outside the access point.

In some cases, the doorbell camera 1230 may scan a barcode on a package.In some examples, the doorbell camera 1230 may capture an image ofbarcode on a package. The doorbell camera 1230 in communication with thecontrol panel 135 may then evaluate the captured image of the barcode todetermine whether the package is expected. If the doorbell camera 1230in communication with the control panel 135 determines that the barcodeis associated with an expected package and/or delivery period, thedoorbell camera 1230 may broadcast instructions to the delivery person1250. The instructions may include a message for example an audiomessage, a video message, or both instructing the delivery person 1250.

In some examples, the doorbell camera 1230 may manage a delivery of apackage once the arrival of an expected delivery is verified (e.g.,verifying delivery information, identity of delivery person). In somecases, the doorbell camera 1230 may provide instructions to the deliveryperson 1250 regarding where to place a package. The instructions may beprovided to the delivery person 1250 upon detecting the delivery person1250 arriving at the smart home 250. For example, the delivery person1250 may knock on the access point 1220, for example, knock or ring adoorbell. Upon detecting the delivery person 1250 at the door, acommunication device (e.g., a speaker at the door that is part of thedoorbell camera 1230) may provide instructions to the delivery person1250.

The instructions may include pre-recorded messages, digitaltext-to-speech messages, etc. For example, the doorbell camera 1230 maytransmit a recorded message to delivery person 1250. The recordedmessage may include instructions how and where to deliver the package.In some examples, the doorbell camera 1230 may provide instructions tothe delivery person 1250 via a data communication. For example, thedelivery person 1250 may receive an email, a text message, etc. In somecases, the delivery person 1250 may be notified that the process ofplacing the delivery at the designated delivery location will berecorded. In some cases, the instructions may be broadcasted to thedelivery person 1250 via doorbell camera 1230 a number of times during apredetermined duration. For example, the instructions may be repeatedtwo times to the delivery person 1250 within a one minute time interval.

In some cases, the doorbell camera 1230 in communication with one ormore sensor units 1210 may determine if the delivery person 1250 placesthe package inside the package delivery zone 1235. Upon determiningwhere the delivery person 1250 places the package inside the packagedelivery zone 1235, the doorbell camera 1230 in communication with oneor more sensor units 1210 may determine a proximity or a differencebetween the designated delivery location and the actual location wherethe package is delivered satisfies a predetermined threshold. Upondetermining the proximity and/or the difference between the designateddelivery location and the actual location where the package is deliveredsatisfies a predetermined threshold, the doorbell camera 1230 may promptthe delivery person 1250 to adjust the location of the packageplacement. For example, the doorbell camera 1230 may provide an audiofeedback (e.g., play a recorded voice instruction, digitally communicatea text-to-speech instruction, etc.), visual feedback via one or moresensor units 1210.

FIG. 13 shows a block diagram 1300 of a device 1305 that supports smartsensing techniques in accordance with aspects of the present disclosure.Device 1305 may be an example of aspects of a control panel 135, a localcomputing device 115, 120, a server 155, or remote computing device 140as described herein. Device 1305 may include receiver 1310, smartsensing manager 1315, and transmitter 1320. Device 1305 may also includea processor. Each of these components may be in communication with oneanother (e.g., via one or more buses).

Receiver 1310 may receive information such as packets, user data, orcontrol information associated with various information channels (e.g.,control channels, data channels, and information related to smartsensing techniques, etc.). Information may be passed on to othercomponents of the device. The receiver 1310 may be an example of aspectsof the transceiver 1635 described with reference to FIG. 16. Thereceiver 1310 may utilize a single antenna or a set of antennas.

Smart sensing manager 1315 and/or at least some of its varioussub-components may be implemented in hardware, software executed by aprocessor, firmware, or any combination thereof. If implemented insoftware executed by a processor, the functions of the smart sensingmanager 1315 and/or at least some of its various sub-components may beexecuted by a general-purpose processor, a digital signal processor(DSP), an application-specific integrated circuit (ASIC), anfield-programmable gate array (FPGA) or other programmable logic device,discrete gate or transistor logic, discrete hardware components, or anycombination thereof designed to perform the functions described in thepresent disclosure.

The smart sensing manager 1315 and/or at least some of its varioussub-components may be physically located at various positions, includingbeing distributed such that portions of functions are implemented atdifferent physical locations by one or more physical devices. In someexamples, smart sensing manager 1315 and/or at least some of its varioussub-components may be a separate and distinct component in accordancewith various aspects of the present disclosure. In other examples, smartsensing manager 1315 and/or at least some of its various sub-componentsmay be combined with one or more other hardware components, includingbut not limited to an I/O component, a transceiver, a network server,another computing device, one or more other components described in thepresent disclosure, or a combination thereof in accordance with variousaspects of the present disclosure.

Smart sensing manager 1315 may monitor a parameter of a resourceassociated with a structure, predict a future change in conditionassociated with the parameter based on the monitoring, and perform afunction using the security and automation system based on thepredicting.

Transmitter 1320 may transmit signals generated by other components ofthe device. In some examples, the transmitter 1320 may be collocatedwith a receiver 1310 in a transceiver module. For example, thetransmitter 1320 may be an example of aspects of the transceiver 1635described with reference to FIG. 16. The transmitter 1320 may utilize asingle antenna or a set of antennas.

FIG. 14 shows a block diagram 1400 of a device 1405 that supports smartsensing techniques in accordance with aspects of the present disclosure.Device 1405 may be an example of aspects of a device 1305 or a controlpanel 135, a local computing device 115, 120, a server 155, or a remotecomputing device 140 as described with reference to FIGS. 1 and 13.Device 1405 may include receiver 1410, smart sensing manager 1415, andtransmitter 1420. Device 1405 may also include a processor. Each ofthese components may be in communication with one another (e.g., via oneor more buses).

Receiver 1410 may receive information such as packets, user data, orcontrol information associated with various information channels (e.g.,control channels, data channels, and information related to smartsensing techniques, etc.). Information may be passed on to othercomponents of the device. The receiver 1410 may be an example of aspectsof the transceiver 1635 described with reference to FIG. 16. Thereceiver 1410 may utilize a single antenna or a set of antennas.

Smart sensing manager 1415 may be an example of aspects of the smartsensing manager 1315 described with reference to FIG. 13. Smart sensingmanager 1415 may also include monitoring component 1425, predictioncomponent 1430, and operating component 1435.

Monitoring component 1425 may monitor a parameter of a resourceassociated with a structure. The monitoring component 1425 may receivereal-time usage data of the resource from a sensor, and track real-timeusage data based on the usage data. In some examples, performing afunction using a security and automation system may be based on trackingthe real-time usage data.

In some cases, the resource includes a service or a product. Themonitoring component 1425 may identify the service or the product, orboth. The monitoring component 1425 may determine that the product is aconsumable item. In some cases, the consumable item includes at leastone of food or beverages, or both. The monitoring component 1425 maydetermine that the product is an apparatus or a household item. In somecases, the service is a structure management service or a personalservice related to an individual associated with the structure. In somecases, the personal service includes at least one of a babysittingservice, a nursing care service, a pet sitting service, a medicalprovider visit service, or any combination thereof. In some cases, thestructure management service includes at least one of a gardening andlawn care service, an internet-provider service, a housekeeping service,a laundry service, a plumbing service, a maintenance service, a termiteand pest control service, a water softener service, or any combinationthereof.

Prediction component 1430 may predict a future change in conditionassociated with the parameter based on the monitoring. The predictioncomponent 1430 may retrieve, from a database, historical usage dataassociated with the service or the product, or both based on theidentifying. The prediction component 1430 may compare the retrievedhistorical usage data with the real-time usage data to compute a usagemodel. In some examples, predicting the future change in conditionassociated with the parameter may be based on the usage model.

The prediction component 1430 may identify a consumption rate of theconsumable item based on a consumption model of the consumable item. Theprediction component 1430 may automatically request a purchase orderwith a third-party enterprise to restock and deliver the consumable itemto the structure. The prediction component 1430 may identify a usagerate of the apparatus or the household item based on a usage model ofthe apparatus or the household item, and automatically request apurchase order or a maintenance order with a third-party enterprise torestock and deliver the household item to the structure or provide amaintenance service of the apparatus.

Operating component 1435 may perform the function using the security andautomation system based on the predicting. In some cases, the functionis performed automatically based on a pre-configured setting of thesecurity and automation system.

Transmitter 1420 may transmit signals generated by other components ofthe device. In some examples, the transmitter 1420 may be collocatedwith a receiver 1410 in a transceiver module. For example, thetransmitter 1420 may be an example of aspects of the transceiver 1635described with reference to FIG. 16. The transmitter 1420 may utilize asingle antenna or a set of antennas.

FIG. 15 shows a block diagram 1500 of a smart sensing manager 1515 thatsupports smart sensing techniques in accordance with aspects of thepresent disclosure. The smart sensing manager 1515 may be an example ofaspects of a smart sensing manager 1315, a smart sensing manager 1415,or a smart sensing manager 1615 described with reference to FIGS. 13,14, and 16. The smart sensing manager 1515 may include monitoringcomponent 1520, prediction component 1525, operating component 1530,schedule component 1535, detection component 1540, validation component1545, connection component 1550, specification component 1555, andrecommendation component 1560. Each of these modules may communicate,directly or indirectly, with one another (e.g., via one or more buses).

Monitoring component 1520 may monitor a parameter of a resourceassociated with a structure. The monitoring component 1520 may receivereal-time usage data of the resource from a sensor, and track real-timeusage data based on the usage data. In some examples, performing afunction using a security and automation system may be based on trackingthe real-time usage data.

In some cases, the resource includes a service or a product. Themonitoring component 1520 may identify the service or the product, orboth. The monitoring component 1520 may determine that the product is aconsumable item. In some cases, the consumable item includes at leastone of food or beverages, or both. The monitoring component 1520 maydetermine that the product is an apparatus or a household item. In somecases, the service is a structure management service or a personalservice related to an individual associated with the structure. In somecases, the personal service includes at least one of a babysittingservice, a nursing care service, a pet sitting service, a medicalprovider visit service, or any combination thereof. In some cases, thestructure management service includes at least one of a gardening andlawn care service, an internet-provider service, a housekeeping service,a laundry service, a plumbing service, a maintenance service, a termiteand pest control service, a water softener service, or any combinationthereof.

Prediction component 1525 may predict a future change in conditionassociated with the parameter based on the monitoring. The predictioncomponent 1525 may retrieve, from a database, historical usage dataassociated with the service or the product, or both based on theidentifying. The prediction component 1525 may compare the retrievedhistorical usage data with the real-time usage data to compute a usagemodel. In some examples, predicting the future change in conditionassociated with the parameter may be based on the usage model.

The prediction component 1525 may identify a consumption rate of theconsumable item based on a consumption model of the consumable item. Theprediction component 1525 may automatically request a purchase orderwith a third-party enterprise to restock and deliver the consumable itemto the structure. The prediction component 1525 may identify a usagerate of the apparatus or the household item based on a usage model ofthe apparatus or the household item, and automatically request apurchase order or a maintenance order with a third-party enterprise torestock and deliver the household item to the structure or provide amaintenance service of the apparatus.

Operating component 1530 may perform the function using the security andautomation system based on the predicting. In some cases, the functionis performed automatically based on a pre-configured setting of thesecurity and automation system.

Schedule component 1535 may identify schedule data of an individualassociated with the structure. The schedule component 1535 mayautomatically schedule a service personnel to visit the structure andperform an action associated with the service based on the schedule dataof the individual. In some cases, performing the function includesautomatically scheduling the service personnel. The schedule component1535 may identify a service provider associated with the service basedon a pre-configured setting. The schedule component 1535 may transmit,to a remote device of the service provider, a message indicating aservice request, where the message includes at least one of a paymentinformation, a geolocation information of the structure, a contactinformation of the individual, or any combination thereof, and receive,from the remote device, an acknowledgment message in response to theservice request.

Detection component 1540 may detect the service personnel based onsensor data received from a sensor. The detection component 1540 mayidentify a time associated with the detecting, and compare theidentified time to a scheduled service time.

Validation component 1545 may validate that the identified time iswithin a threshold limit of the scheduled service time. The validationcomponent 1545 may provide, to a device of the service personnel, accessinformation to the structure based at least on the validating, where theaccess information includes at least one of a random code, a PIN, orinstructions for providing the service to a designated zone of thestructure, or any combination thereof. In some cases, performing thefunction may include providing to the device of the service personnelthe access information to the structure. The validation component 1545may operate a garage door opener based on the validating. In some cases,performing the function may include operating the garage door opener.

Connection component 1550 may establish a connection with the apparatus.Specification component 1555 may retrieve specification informationassociated with the apparatus based on performing a scan using theestablished connection. In some examples, the specification informationmay include warranty coverage information, appliance repair and supportinformation, vendor information, an energy consumption and cost reportof operating the apparatus, or any combination thereof.

Recommendation component 1560 may determine a set of recommended actionsto perform based on the future change in condition. The recommendationcomponent 1560 may generate a message indicating the future change incondition and an option to select at least one recommended action fromthe set. The recommendation component 1560 may transmit the message to adevice of an individual associated with the security and automationsystem, and receive, from the device, a message indicating a selectionof a recommended action from the set. In some cases, performing thefunction using the security and automation system is based on thereceived message.

FIG. 16 shows a diagram of a system 1600 including a device 1605 thatsupports smart sensing techniques in accordance with aspects of thepresent disclosure. Device 1605 may be an example of or include thecomponents of device 1305, device 1405, or a control panel 135, a localcomputing device 115, 120, a server 155, or a remote computing device140 as described above, e.g., with reference to FIGS. 1, 13, and 14.Device 1605 may include components for bi-directional voice and datacommunications including components for transmitting and receivingcommunications, including smart sensing manager 1615, processor 1620,memory 1625, software 1630, transceiver 1635, I/O controller 1640, anduser interface 1645. These components may be in electronic communicationvia one or more buses (e.g., bus 1610).

In some cases, device 1605 may communicate with a remote computingdevice 140, and/or a remote server (e.g., server 155). For example, oneor more elements of device 1605 may provide a direct connection to theserver 155 via a direct network link to the Internet via a POP (point ofpresence). In some cases, one element of device 1605 (e.g., one or moreantennas, transceivers, etc.) may provide a connection using wirelesstechniques, including digital cellular telephone connection, CellularDigital Packet Data (CDPD) connection, digital satellite dataconnection, and/or another connection.

Many other devices and/or subsystems may be connected to one or may beincluded as one or more elements of system 1600 (e.g., entertainmentsystem, computing device, remote cameras, wireless key fob, wall mounteduser interface device, cell radio module, battery, alarm siren, doorlock, lighting system, thermostat, home appliance monitor, utilityequipment monitor, and so on). In some cases, all of the elements shownin FIG. 16 need not be present to practice the present systems andmethods. The devices and subsystems may also be interconnected indifferent ways from that shown in FIG. 16. In some cases, an aspect ofthe operations of system 1600 may be readily known in the art and arenot discussed in detail in this disclosure.

The signals associated with system 1600 may include wirelesscommunication signals such as radio frequency, electromagnetics, localarea network (LAN), wide area network (WAN), virtual private network(VPN), wireless network (using 802.11, for example), 345 MHz, Z-WAVE®,cellular network (using 3G and/or Long Term Evolution (LTE), forexample), and/or other signals. The radio access technology (RAT) ofsystem 1600 may be related to, but are not limited to, WWAN (GSM, CDMA,and WCDMA), wireless local area network (WLAN) (including user equipment(UE) BLUETOOTH® and Wi-Fi), WMAN (WiMAX), antennas for mobilecommunications, antennas for Wireless Personal Area Network (WPAN)applications (including RFID and UWB). In some cases, one or moresensors (e.g., motion, proximity, smoke, light, glass break, door,window, carbon monoxide, and/or another sensor) may connect to someelement of system 1600 via a network using the one or more wired and/orwireless connections.

Processor 1620 may include an intelligent hardware device, (e.g., ageneral-purpose processor, a DSP, a central processing unit (CPU), amicrocontroller, an ASIC, an FPGA, a programmable logic device, adiscrete gate or transistor logic component, a discrete hardwarecomponent, or any combination thereof). In some cases, processor 1620may be configured to operate a memory array using a memory controller.In other cases, a memory controller may be integrated into processor1620. Processor 1620 may be configured to execute computer-readableinstructions stored in a memory to perform various functions (e.g.,functions or tasks supporting smart sensing techniques).

Memory 1625 may include random access memory (RAM) and read only memory(ROM). The memory 1625 may store computer-readable, computer-executablesoftware 1630 including instructions that, when executed, cause theprocessor to perform various functions described herein. In some cases,the memory 1625 may contain, among other things, a basic input/outputsystem (BIOS) which may control basic hardware or software operationsuch as the interaction with peripheral components or devices.

Software 1630 may include code to implement aspects of the presentdisclosure, including code to support smart sensing techniques. Software1630 may be stored in a non-transitory computer-readable medium such assystem memory or other memory. In some cases, the software 1630 may notbe directly executable by the processor but may cause a computer (e.g.,when compiled and executed) to perform functions described herein.

Transceiver 1635 may communicate bi-directionally, via one or moreantennas, wired, or wireless links as described above. For example, thetransceiver 1635 may represent a wireless transceiver and maycommunicate bi-directionally with another wireless transceiver. Thetransceiver 1635 may also include a modem to modulate the packets andprovide the modulated packets to the antennas for transmission, and todemodulate packets received from the antennas.

I/O controller 1640 may manage input and output signals for device 1605.I/O controller 1640 may also manage peripherals not integrated intodevice 1605. In some cases, I/O controller 1640 may represent a physicalconnection or port to an external peripheral. In some cases, I/Ocontroller 1640 may utilize an operating system such as iOS®, ANDROID®,MS-DOS®, MS-WINDOWS®, OS/2®, UNIX®, LINUX®, or another known operatingsystem. In other cases, I/O controller 1640 may represent or interactwith a modem, a keyboard, a mouse, a touchscreen, or a similar device.In some cases, I/O controller 1640 may be implemented as part of aprocessor. In some cases, a user may interact with device 1605 via I/Ocontroller 1640 or via hardware components controlled by I/O controller1640.

User interface 1645 may enable a user to interact with device 1605. Insome cases, the user interface module 1645 may include an audio device,such as an external speaker system, an external display device such as adisplay screen, or an input device (e.g., remote control deviceinterfaced with the user interface module 1645 directly or through theI/O controller module).

FIG. 17 shows a flowchart illustrating a method 1700 for smart sensingtechniques in accordance with aspects of the present disclosure. Theoperations of method 1700 may be implemented by a control panel 135 orits components as described herein. For example, the operations ofmethod 1700 may be performed by a smart sensing manager as describedwith reference to FIGS. 13 through 16. In some cases, additionally oralternatively, the operations of method 1700 may be implemented by alocal computing device 115, 120, a server 155, or a remote computingdevice 140 or its components as described herein. In some examples, acontrol panel 135 may execute a set of codes to control the functionalelements of the device to perform the functions described below.Additionally or alternatively, the control panel 135 may perform aspectsof the functions described below using special-purpose hardware.

At 1705 the control panel 135 may monitor a parameter of a resourceassociated with a structure. The operations of 1705 may be performedaccording to the methods described herein. In certain examples, aspectsof the operations of 1705 may be performed by a monitoring component asdescribed with reference to FIGS. 14 and 15.

At 1710 the control panel 135 may predict a future change in conditionassociated with the parameter based on the monitoring. The operations of1710 may be performed according to the methods described herein. Incertain examples, aspects of the operations of 1710 may be performed bya prediction component as described with reference to FIGS. 14 and 15.

At 1715 the control panel 135 may perform a function using the securityand automation system based on the predicting. The operations of 1715may be performed according to the methods described herein. In certainexamples, aspects of the operations of 1715 may be performed by anoperating component as described with reference to FIGS. 14 and 15.

FIG. 18 shows a flowchart illustrating a method 1800 for smart sensingtechniques in accordance with aspects of the present disclosure. Theoperations of method 1800 may be implemented by a control panel 135 orits components as described herein. For example, the operations ofmethod 1800 may be performed by a smart sensing manager as describedwith reference to FIGS. 13 through 16. In some cases, additionally oralternatively, the operations of method 1800 may be implemented by alocal computing device 115, 120, a server 155, or a remote computingdevice 140 or its components as described herein. In some examples, acontrol panel 135 may execute a set of codes to control the functionalelements of the device to perform the functions described below.Additionally or alternatively, the control panel 135 may perform aspectsof the functions described below using special-purpose hardware.

At 1805 the control panel 135 may monitor a parameter of a resourceassociated with a structure. The operations of 1805 may be performedaccording to the methods described herein. In certain examples, aspectsof the operations of 1805 may be performed by a monitoring component asdescribed with reference to FIGS. 14 and 15.

At 1810 the control panel 135 may identify a service or a product, orboth based on the resource. The operations of 1810 may be performedaccording to the methods described herein. In certain examples, aspectsof the operations of 1810 may be performed by a monitoring component asdescribed with reference to FIGS. 14 and 15.

At 1815 the control panel 135 may retrieve, from a database, historicalusage data associated with the service or the product, or both based onthe identifying. The operations of 1815 may be performed according tothe methods described herein. In certain examples, aspects of theoperations of 1815 may be performed by a prediction component asdescribed with reference to FIGS. 14 and 15.

At 1820 the control panel 135 may compare the retrieved historical usagedata with the real-time usage data to compute a usage model, wherepredicting the future change in condition associated with the parameteris based on the usage model. The operations of 1820 may be performedaccording to the methods described herein. In certain examples, aspectsof the operations of 1820 may be performed by a prediction component asdescribed with reference to FIGS. 14 and 15.

At 1825 the control panel 135 may predict a future change in conditionassociated with the parameter based on the usage model. The operationsof 1825 may be performed according to the methods described herein. Incertain examples, aspects of the operations of 1825 may be performed bya prediction component as described with reference to FIGS. 14 and 15.

At 1830 the control panel 135 may perform a function using the securityand automation system based on the predicting. The operations of 1830may be performed according to the methods described herein. In certainexamples, aspects of the operations of 1830 may be performed by anoperating component as described with reference to FIGS. 14 and 15.

FIG. 19 shows a flowchart illustrating a method 1900 for smart sensingtechniques in accordance with aspects of the present disclosure. Theoperations of method 1900 may be implemented by a control panel 135 orits components as described herein. For example, the operations ofmethod 1900 may be performed by a smart sensing manager as describedwith reference to FIGS. 13 through 16. In some cases, additionally oralternatively, the operations of method 1900 may be implemented by alocal computing device 115, 120, a server 155, or a remote computingdevice 140 or its components as described herein. In some examples, acontrol panel 135 may execute a set of codes to control the functionalelements of the device to perform the functions described below.Additionally or alternatively, the control panel 135 may perform aspectsof the functions described below using special-purpose hardware.

At 1905 the control panel 135 may monitor a parameter of a resourceassociated with a structure. The operations of 1905 may be performedaccording to the methods described herein. In certain examples, aspectsof the operations of 1905 may be performed by a monitoring component asdescribed with reference to FIGS. 14 and 15.

At 1910 the control panel 135 may predict a future change in conditionassociated with the parameter based on the monitoring. The operations of1910 may be performed according to the methods described herein. Incertain examples, aspects of the operations of 1910 may be performed bya prediction component as described with reference to FIGS. 14 and 15.

At 1915 the control panel 135 may identify schedule data of anindividual associated with the structure. The operations of 1915 may beperformed according to the methods described herein. In certainexamples, aspects of the operations of 1915 may be performed by aschedule component as described with reference to FIG. 15.

At 1920 the control panel 135 may automatically schedule a servicepersonnel to visit the structure and perform an action associated withthe service based on the schedule data of the individual and thepredicting. The operations of 1920 may be performed according to themethods described herein. In certain examples, aspects of the operationsof 1920 may be performed by a schedule component as described withreference to FIG. 15.

FIG. 20 shows a flowchart illustrating a method 2000 for smart sensingtechniques in accordance with aspects of the present disclosure. Theoperations of method 2000 may be implemented by a control panel 135 orits components as described herein. For example, the operations ofmethod 2000 may be performed by a smart sensing manager as describedwith reference to FIGS. 13 through 16. In some cases, additionally oralternatively, the operations of method 2000 may be implemented by alocal computing device 115, 120, a server 155, or a remote computingdevice 140 or its components as described herein. In some examples, acontrol panel 135 may execute a set of codes to control the functionalelements of the device to perform the functions described below.Additionally or alternatively, the control panel 135 may perform aspectsof the functions described below using special-purpose hardware.

At 2005 the control panel 135 may monitor a parameter of a resourceassociated with a structure. The operations of 2005 may be performedaccording to the methods described herein. In certain examples, aspectsof the operations of 2005 may be performed by a monitoring component asdescribed with reference to FIGS. 14 and 15.

At 2010 the control panel 135 may determine that the resource is aconsumable item. The operations of 2010 may be performed according tothe methods described herein. In certain examples, aspects of theoperations of 2010 may be performed by a monitoring component asdescribed with reference to FIGS. 14 and 15.

At 2015 the control panel 135 may identify a consumption rate of theconsumable item based on a consumption model of the consumable item. Theoperations of 2015 may be performed according to the methods describedherein. In certain examples, aspects of the operations of 2015 may beperformed by a prediction component as described with reference to FIGS.14 and 15.

At 2020 the control panel 135 may automatically request a purchase orderwith a third-party enterprise to restock and deliver the consumable itemto the structure. The operations of 2020 may be performed according tothe methods described herein. In certain examples, aspects of theoperations of 2020 may be performed by a prediction component asdescribed with reference to FIGS. 14 and 15.

FIG. 21 shows a flowchart illustrating a method 2100 for smart sensingtechniques in accordance with aspects of the present disclosure. Theoperations of method 2100 may be implemented by a control panel 135 orits components as described herein. For example, the operations ofmethod 2100 may be performed by a smart sensing manager as describedwith reference to FIGS. 13 through 16. In some cases, additionally oralternatively, the operations of method 2100 may be implemented by alocal computing device 115, 120, a server 155, or a remote computingdevice 140 or its components as described herein. In some examples, acontrol panel 135 may execute a set of codes to control the functionalelements of the device to perform the functions described below.Additionally or alternatively, the control panel 135 may perform aspectsof the functions described below using special-purpose hardware.

At 2105 the control panel 135 may monitor a parameter of a resourceassociated with a structure. The operations of 2105 may be performedaccording to the methods described herein. In certain examples, aspectsof the operations of 2105 may be performed by a monitoring component asdescribed with reference to FIGS. 14 and 15.

At 2110 the control panel 135 may determine that the resource is anapparatus or a household item. The operations of 2110 may be performedaccording to the methods described herein. In certain examples, aspectsof the operations of 2110 may be performed by a monitoring component asdescribed with reference to FIGS. 14 and 15.

At 2115 the control panel 135 may identify a usage rate of the apparatusor the household item based on a usage model of the apparatus or thehousehold item. The operations of 2115 may be performed according to themethods described herein. In certain examples, aspects of the operationsof 2115 may be performed by a prediction component as described withreference to FIGS. 14 and 15.

At 2120 the control panel 135 may automatically request a purchase orderor a maintenance order with a third-party enterprise to restock anddeliver the household item to the structure or provide a maintenanceservice of the apparatus. The operations of 2120 may be performedaccording to the methods described herein. In certain examples, aspectsof the operations of 2120 may be performed by a prediction component asdescribed with reference to FIGS. 14 and 15.

The detailed description set forth above in connection with the appendeddrawings describes examples and does not represent the only instancesthat may be implemented or that are within the scope of the claims. Theterms “example” and “exemplary,” when used in this description, mean“serving as an example, instance, or illustration,” and not “preferred”or “advantageous over other examples.” The detailed description includesspecific details for the purpose of providing an understanding of thedescribed techniques. These techniques, however, may be practicedwithout these specific details. In some instances, known structures andapparatuses are shown in block diagram form in order to avoid obscuringthe concepts of the described examples.

Information and signals may be represented using any of a variety ofdifferent technologies and techniques. For example, data, instructions,commands, information, signals, bits, symbols, and chips that may bereferenced throughout the above description may be represented byvoltages, currents, electromagnetic waves, magnetic fields or particles,optical fields or particles, or any combination thereof.

The various illustrative blocks and components described in connectionwith this disclosure may be implemented or performed with ageneral-purpose processor, a digital signal processor (DSP), an ASIC, anFPGA or other programmable logic device, discrete gate or transistorlogic, discrete hardware components, or any combination thereof designedto perform the functions described herein. A general-purpose processormay be a microprocessor, but in the alternative, the processor may beany conventional processor, controller, microcontroller, and/or statemachine. A processor may also be implemented as a combination ofcomputing devices, e.g., a combination of a DSP and a microprocessor,multiple microprocessors, one or more microprocessors in conjunctionwith a DSP core, and/or any other such configuration. An operatingsystem utilized by the processor (or by I/O controller module or anothermodule described above) may be iOS®, ANDROID®, MS-DOS®, MS-WINDOWS®,OS/2®, UNIX®, LINUX®, or another known operating system.

The functions described herein may be implemented in hardware, softwareexecuted by a processor, firmware, or any combination thereof. Ifimplemented in software executed by a processor, the functions may bestored on or transmitted over as one or more instructions or code on acomputer-readable medium. Other examples and implementations are withinthe scope and spirit of the disclosure and appended claims. For example,due to the nature of software, functions described above can beimplemented using software executed by a processor, hardware, firmware,hardwiring, or combinations of any of these. Features implementingfunctions may also be physically located at various positions, includingbeing distributed such that portions of functions are implemented atdifferent physical locations.

As used herein, including in the claims, the term “and/or,” when used ina list of two or more items, means that any one of the listed items canbe employed by itself, or any combination of two or more of the listeditems can be employed. For example, if a composition is described ascontaining components A, B, and/or C, the composition can contain Aalone; B alone; C alone; A and B in combination; A and C in combination;B and C in combination; or A, B, and C in combination. Also, as usedherein, including in the claims, “or” as used in a list of items (forexample, a list of items prefaced by a phrase such as “at least one of”or “one or more of”) indicates a disjunctive list such that, forexample, a list of “at least one of A, B, or C” means A or B or C or ABor AC or BC or ABC (i.e., A and B and C). Also, as used herein, thephrase “based on” shall not be construed as a reference to a closed setof conditions. For example, an exemplary step that is described as“based on condition A” may be based on both a condition A and acondition B without departing from the scope of the present disclosure.In other words, as used herein, the phrase “based on” shall be construedin the same manner as the phrase “based at least in part on.”

In addition, any disclosure of components contained within othercomponents or separate from other components should be consideredexemplary because multiple other architectures may potentially beimplemented to achieve the same functionality, including incorporatingall, most, and/or some elements as part of one or more unitarystructures and/or separate structures.

Computer-readable media includes both computer storage media andcommunication media including any medium that facilitates transfer of acomputer program from one place to another. A storage medium may be anyavailable medium that can be accessed by a general purpose or specialpurpose computer. By way of example, and not limitation,computer-readable media can comprise RAM, ROM, EEPROM, flash memory,CD-ROM, DVD, or other optical disk storage, magnetic disk storage orother magnetic storage devices, or any other medium that can be used tocarry or store desired program code means in the form of instructions ordata structures and that can be accessed by a general-purpose orspecial-purpose computer, or a general-purpose or special-purposeprocessor. Also, any connection is properly termed a computer-readablemedium. For example, if the software is transmitted from a website,server, or other remote source using a coaxial cable, fiber optic cable,twisted pair, digital subscriber line (DSL), or wireless technologiessuch as infrared, radio, and microwave, then the coaxial cable, fiberoptic cable, twisted pair, DSL, or wireless technologies such asinfrared, radio, and microwave are included in the definition of medium.Disk and disc, as used herein, include compact disc (CD), laser disc,optical disc, digital versatile disc (DVD), floppy disk and Blu-ray discwhere disks usually reproduce data magnetically, while discs reproducedata optically with lasers. Combinations of the above are also includedwithin the scope of computer-readable media.

The previous description of the disclosure is provided to enable aperson skilled in the art to make or use the disclosure. Variousmodifications to the disclosure will be readily apparent to thoseskilled in the art, and the generic principles defined herein may beapplied to other variations without departing from the scope of thedisclosure. Thus, the disclosure is not to be limited to the examplesand designs described herein but is to be accorded the broadest scopeconsistent with the principles and novel features disclosed.

This disclosure may specifically apply to security system applications.This disclosure may specifically apply to automation systemapplications. In some cases, the concepts, the technical descriptions,the features, the methods, the ideas, and/or the descriptions mayspecifically apply to security and/or automation system applications.Distinct advantages of such systems for these specific applications areapparent from this disclosure.

The process parameters, actions, and steps described and/or illustratedin this disclosure are given by way of example only and can be varied asdesired. For example, while the steps illustrated and/or described maybe shown or discussed in a particular order, these steps do notnecessarily need to be performed in the order illustrated or discussed.The various exemplary methods described and/or illustrated here may alsoomit one or more of the steps described or illustrated here or includeadditional steps in addition to those disclosed.

Furthermore, while various cases have been described and/or illustratedhere in the context of fully functional computing systems, one or moreof these exemplary cases may be distributed as a program product in avariety of forms, regardless of the particular type of computer-readablemedia used to actually carry out the distribution. The cases disclosedherein may also be implemented using software modules that performcertain tasks. These software modules may include script, batch, orother executable files that may be stored on a computer-readable storagemedium or in a computing system. In some cases, these software modulesmay permit and/or instruct a computing system to perform one or more ofthe exemplary cases disclosed here.

This description, for purposes of explanation, has been described withreference to specific cases. The illustrative discussions above,however, are not intended to be exhaustive or limit the present systemsand methods to the precise forms discussed. Many modifications andvariations are possible in view of the above teachings. The cases werechosen and described in order to explain the principles of the presentsystems and methods and their practical applications, to enable othersskilled in the art to utilize the present systems, apparatus, andmethods and various cases with various modifications as may be suited tothe particular use contemplated.

What is claimed is:
 1. A method for smart sensing using a control panelof a home automation system, comprising: determining, by a processor ofthe control panel of the home automation system, a parameter of aresource associated with a home; monitoring the parameter of theresource based on sensor data captured by a plurality of sensors thatare communicatively coupled to the control panel of the home automationsystem; predicting, by the processor of the control panel of the homeautomation system, a future change in condition associated with theparameter satisfying a threshold as detected by a sensor, the predictingbased at least in part on a machine learning model, the machine learningmodel trained on previously captured sensor data associated with themonitored parameter; in response to predicting the future change incondition satisfies the threshold, performing a function that includesgenerating a first message, for display on a device of the individualassociated with the home automation system, comprising selectableoptions, wherein the selectable options include a first option todisplay a set of recommended actions to perform by the home automationsystem based at least in part on the future change in condition and asecond option to view a time-lapse of the resource associated with themonitored parameter, wherein the time-lapse is generated based on adetected change in an attribute across video frames; transmitting thefirst message to the device of the individual and receiving selection ofthe first option; in response to receiving selection of the firstoption, generating a second message with at least one recommended optionthat includes scheduling a service appointment; receiving selection ofthe at least one recommended option and scheduling, by the processor ofthe control panel of the home automation system, a service personnel toperform a service associated with the resource based on the predictedfuture change in condition; detecting, by the processor of the controlpanel of the home automation system, the service personnel at the homebased on sensor data; and actuating, by the processor of the controlpanel of the home automation system and in response to validating thatthe service personnel arrives at a time that is within a threshold timeof a scheduled time for the service, an access point to the home toprovide the service personnel access into the home for performing theservice associated with the resource.
 2. The method of claim 1, whereinmonitoring the parameter of the resource comprises: receiving real-timeusage data of the resource from the sensor; and tracking real-time usagedata based at least in part on the received real-time usage data,wherein performing the function is based at least in part on trackingthe real-time usage data.
 3. The method of claim 1, wherein the resourcecomprises a service or a product.
 4. The method of claim 2, furthercomprising: identifying a service or a product, or both; retrieving,from a database, historical usage data associated with the service orthe product, or both based at least in part on the identifying; andcomparing the retrieved historical usage data with the real-time usagedata to compute a usage model, wherein predicting the future change incondition associated with the parameter is based at least in part on theusage model.
 5. The method of claim 1, wherein the function is performedautomatically based at least in part on a pre-configured setting of thehome automation system.
 6. The method of claim 5, further comprising:identifying that the resource is a service; identifying schedule data ofthe individual associated with the home; and automatically schedulingthe service personnel to visit the home and perform an action associatedwith the service based at least in part on the schedule data of theindividual.
 7. The method of claim 6, wherein automatically schedulingthe service personnel comprises: identifying a service providerassociated with the service based at least in part on the pre-configuredsetting; and transmitting, to a remote device of the service provider, amessage indicating a service request, wherein the message comprises atleast one of a payment information, a geolocation information of thehome, a contact information of the individual, or any combinationthereof.
 8. The method of claim 7, further comprising: receiving, fromthe remote device, an acknowledgment message in response to the servicerequest.
 9. The method of claim 7, wherein the validating comprises:detecting the service personnel based at least in part on sensor datareceived from a second sensor; identifying a time associated with thedetecting; comparing the identified time to a scheduled service time;validating that the identified time is within a threshold limit of thescheduled service time; and providing, to a device of the servicepersonnel, access information to the home based at least on thevalidating, wherein the access information comprises at least one of arandom code, a personal identification number (PIN), or instructions forproviding the service to a designated zone of the home, or anycombination thereof, wherein actuating the access point comprisesproviding to the device of the service personnel the access informationto the home.
 10. The method of claim 9, further comprising: operating agarage door opener based at least in part on the validating, whereinactuating the access point comprises operating the garage door opener.11. The method of claim 3, further comprising: determining that theresource is a product comprising an apparatus; identifying a usage rateof the apparatus based at least in part on a usage model ofautomatically requesting a maintenance order with a third-partyenterprise to provide a maintenance service of the apparatus.
 12. Themethod of claim 11, further comprising: establishing a connection withthe apparatus; and retrieving specification information associated withthe apparatus based at least in part on performing a scan using theestablished connection, wherein the specification information compriseswarranty coverage information, appliance repair and support information,vendor information, an energy consumption and cost report of operatingthe apparatus, or any combination thereof.
 13. The method of claim 1,wherein the resource is a home management service or a personal servicerelated to the individual associated with the home.
 14. The method ofclaim 13, wherein the home management service comprises at least one ofa gardening and lawn care service, an internet-provider service, ahousekeeping service, a laundry service, a plumbing service, amaintenance service, a termite and pest control service, a watersoftener service, or any combination thereof.
 15. The method of claim13, wherein the personal service comprises at least one of a babysittingservice, a nursing care service, a pet sitting service, a medicalprovider visit service, or any combination thereof.
 16. An apparatus forsmart sensing using a control panel of a home automation system,comprising: a processor; memory in electronic communication with theprocessor; and instructions stored in the memory and executable by theprocessor to cause the apparatus to: determine, by the processor of thecontrol panel of the home automation system, a parameter of a resourceassociated with a home; monitor the parameter of the resource based onsensor data captured by a plurality of sensors that are communicativelycoupled to the control panel of the home automation system; predict, bythe processor of the control panel of the home automation system, afuture change in condition associated with the parameter satisfying athreshold as detected by a sensors, the predicting based at least inpart on a machine learning model, the machine learning model trained onpreviously captured sensor data associated with the monitored parameter;in response to predicting the future change in condition satisfies thethreshold, perform a function that includes generating a first message,for display on a device of the individual associated with the homeautomation system, comprising selectable options, wherein the selectableoptions include a first option to display a set of recommended actionsto perform by the home automation system based at least in part on thefuture change in condition and a second option to view a time-lapse ofthe resource associated with the monitored parameter, wherein thetime-lapse is generated based on a detected change in an attributeacross video frames; transmit the first message to the device of theindividual and receiving selection of the first option; in response toreceiving selection of the first option, generate a second message withat least one recommended option that includes scheduling a serviceappointment; receive selection of the at least one recommended optionand scheduling, by the processor of the control panel of the homeautomation system, a service personnel to perform a service associatedwith the resource based on the predicted future change in condition;detect, by the processor of the control panel of the home automationsystem, the service personnel at the home based on sensor data; andactuate, by the processor of the control panel of the home automationsystem and in response to validating that the service personnel arrivesat a time that is within a threshold time of a scheduled time for theservice, an access point to the home to provide the service personnelaccess into the home for performing the service associated with theresource.
 17. The apparatus of claim 16, wherein monitoring theparameter of the resource comprises: receiving real-time usage data ofthe resource from the sensor; and tracking real-time usage data based atleast in part on the received real-time usage data, wherein performingthe function is based at least in part on tracking the real-time usagedata.
 18. The apparatus of claim 16, wherein the instructions areexecutable by the processor to cause the apparatus to: identify aservice or a product, or both; retrieve, from a database, historicalusage data associated with the service or the product, or both based atleast in part on the identifying; and compare the retrieved historicalusage data with the real-time usage data to compute a usage model,wherein predicting the future change in condition associated with theparameter is based at least in part on the usage model.
 19. Acomputer-program product for determining occupancy with user providedinformation, the computer-program product comprising a non-transitorycomputer-readable medium having instructions thereon, the instructionsbeing executable by a processor to: determine, by a processor of acontrol panel of the home automation system, a parameter of a resourceassociated with a home; monitor the parameter of the resource based onsensor data captured by a plurality of sensors that are communicativelycoupled to the control panel of the home automation system; predict, bythe processor of the control panel of the home automation system, afuture change in condition associated with the parameter satisfying athreshold as detected by a sensors, the predicting based at least inpart on a machine learning model, the machine learning model trained onpreviously captured sensor data associated with the monitored parameterexcluding input from a set of occupants; in response to predicting thefuture change in condition satisfies the threshold, perform a functionthat includes generating a first message, for display on a device of theindividual associated with the home automation system, comprisingselectable options, wherein the selectable options include a firstoption to display a set of recommended actions to perform by the homeautomation system based at least in part on the future change incondition and a second option to view a time-lapse of the resourceassociated with the monitored parameter, wherein the time-lapse isgenerated based on a detected change in an attribute across videoframes; transmit the first message to the device of the individual andreceiving selection of the first option; in response to receivingselection of the first option, generate a second message with at leastone recommended option that includes scheduling a service appointment;receive selection of the at least one recommended option and scheduling,by the processor of the control panel of the home automation system, aservice personnel to perform a service associated with the resourcebased on the predicted future change in condition; detect, by theprocessor of the control panel of the home automation system, theservice personnel at the home based on sensor data; and actuate, by theprocessor of the control panel of the home automation system and inresponse to validating that the service personnel arrives at a time thatis within a threshold time of a scheduled time for the service, anaccess point to the home to provide the service personnel access intothe home for performing the service associated with the resource. 20.The computer-program product of claim 19, wherein monitoring theparameter of the resource comprises: receiving real-time usage data ofthe resource from the sensor; and tracking real-time usage data based atleast in part on the received real-time usage data, wherein performingthe function is based at least in part on tracking the real-time usagedata.